ERCIM News No. 145 Special theme: "E-Values - Statistical Testing for the 21st Century"

ERCIM NEWS No. 145 -

Dear ERCIM News reader, ever heard of e-values?

If not, you're probably not alone. 

Michael I. Jordan opens this issue with a keynote introducing the concept:

What is an “e-value” and why has it become an object of intense study in statistics and in the allied fields of machine learning, signal processing, and econometrics? To briefly introduce the basic idea, let us consider one of the core problems in statistics – the “hypothesis testing problem” of deciding whether observed data is consistent with some particular data-generating mechanism (often referred to as a “null hypothesis”) or is better explained by another mechanism (referred to as an “alternative hypothesis”). This problem is addressed by defining some function of the data (a “statistic”) whose distribution is as different as possible under the null and the alternative. Given an observed value of such a statistic, one then makes a choice between the two distributions, doing so in a way that minimizes the probability of errors. Classical statistical theory provides a unifying framework – the “p-value” – by which the choice between the null and alternative hypotheses reduces to a thresholding procedure.

Guest editors Peter Grünwald (CWI and Leiden University), Wouter Koolen (CWI and University of Twente) and Johanna Ziegel (ETH Zurich) guide readers through this emerging framework for quantifying statistical evidence. 

The articles in this special theme demonstrate how it is already finding applications across many areas of scientific research, from clinical trials and microbiome studies to political polls, AI evaluation and financial risk backtesting.

 

<>

I must admit when I read 'e-values', I thought of an e-rendering of ethics - humanities and sciences (qualitative-quantitative : subjective-objective : ...), but as always a welcome resource.

Includes:

p.6 Introduction to the Special Theme - E-values Statistical Testing for the 21st Century
by the guest editors Peter Grünwald (CWI and Leiden University), Wouter Koolen (CWI and University of Twente) and Johanna Ziegel (ETH Zurich) 

p.8 On Testing by Imaginary Betting^
by Glenn Shafer

'Cournot’s principle does a lot of work. We predict events that have very high probability. We use the happening of events with very small probabilities to discredit theories that attribute the small probabilities to them. (Here the small probabilities are called p-values.)'. p.8.

p.37 Large Language Models as Design Partners: Automating Graphical Mockups to Refine Requirements
by Giovanna Broccia, Maurice H. ter Beek (CNR-ISTI), and Alessio Ferrari (University College Dublin and CNR-ISTI) 

p.39 Challenges in Small-Scale Medical Data Exchange Platform Development
by Hubert Schölnast, Peter Kieseberg, Patrick Kochberger and Henri Ruotsalainen (University of Applied Sciences St. Pölten) 

p.42 SCIANCE: AI for Scientific Discovery in Europe
by András Benczúr, Edina Nemeth (SZTAKI), Jonas L'Haridon (European Science Foundation) and Magdalena Brus (EGI Foundation)

My source: Peter Kunz c/o ERCIM News

^As a community mental health nurse I have a problem with the betting and gambling industries. Yes, many participants 'gamble responsibly', they know when to take a break. They understand the house rules. For a significant number of the population, they are vulnerable. Bitcoin is another example. There the 'house' is continually re-built after successive collapses. But the mathematics here in p-values, v-values and in clinical reasoning is also significant as a crucial element whether naive or formal research.

I have always thought that -

1. Hodges' model presents an implicit theory (as per many models - given their purpose).
2. It follows, that Hodges' model can also do a lot of work.

NW England: UCLAN - Postgraduate Student Conference 2015 Designing and Delivering Research to Inform Clinical Practice

School of Health

Monday 26th January 2015 

9am to 4pm Adelphi Conference Room

A series of short talks to stimulate and inform those contemplating, planning and undertaking research

Supporting UCLan’s postgraduate students

8.30 Registration. 9.00 Start.  

9.00 – Welcome by Professor Tim Thornton, Professor of Philosophy and Mental Health. Why do we need different research methods?  Chair: Professor Caroline Watkins, UCLan School of Health Director of Research.  

9.20 – Dr Louise Connell, NIHR Career Development Research Fellow. Developing a health research career.  

9.40 – 10.20 Session 1 - Systematically reviewing the evidence.  
• Dr Stephanie Jones, Senior Research Fellow & Colette Miller, Research Assistant. Searching the literature to explore what impact training health professionals has on patient outcome. 
• Dr Gill Thomson, Senior Research Fellow Maternal and Infant Nutrition and Nurture Unit (MAINN). Metasynthesis – why and how we do it. 

10.20 - 10.30 Questions 

BREAK – 10.30– 11.00 (30 minutes tea/coffee/networking) 

11.00 – 12.00 Session 2 - Clinical Trials and complex interventions. 
• Dr Chris Sutton, Principal Lecturer and Associate Director Lancashire Clinical Trials Unit. The role of feasibility trials in the development and evaluation of complex interventions. 
• Dr Michael Leathley, Post Doctoral Research Fellow/Principal Lecturer (Research). Health economics in feasibility trials. 
• Dr Lois Thomas, Reader in Health Services Research. What do process evaluations contribute to trials of complex interventions?  An example from the ICONS: Identifying Continence OptioNs after Stroke Trial.  

12.00– 12.20 Questions  

LUNCH 12.20 until 13.20 networking. Sandwich lunch provided  

13.20 Chair: TBC  13.20 – 14.20 Session 3 - Implementation science and service user involvement. 
• Dr Rob Monks, Senior Lecturer and John Billington. Experienced-based co-design. 
• Dr Mick McKeown, Principal Lecturer, Centre for Mental Health and Wellbeing. & Fiona Jones, Community Futures.  Activism, action and alliances: meaningful involvement in research.  

14.20 – 15.00 Session 4 Qualitative research to answer health and social care questions. 
• Dr Janine Arnott, Research Fellow, Children’s, Families and Transitions. Data collection from children. 
• Prof Soo Downe, How qualitative research can influence national and global policy in maternal and child health.  

15.00 – 15.20 Questions  

15.20 – Dr Alexis Holden, Head of UCLan Funding Development and Support. ‘UCLan Research and Innovation Office (RIO) – How can we help you?’  

15.40 – Final session - TBC.  

16.00 CLOSE

...

Adelphi Building, Preston (Adelphi Conference Room, UCLan's Adelphi Building, Adelphi Street, Preston, PR1 7AY

[ I only learned of this event yesterday afternoon and have managed to secure leave and a place - there are a few more left. ]