Ngā hononga kura-whānau e puta ai ngā ihu o ngā ākonga Māori

Using evidence in inquiry

 

The importance of schools using data rigorously throughout inquiry is one theme that emerged from the Ruia exploratory study.

Schools should use date to:

  • understand the initial situation
  • monitor how teachers and students respond to new learning
  • find out what the changes have been during a cycle of inquiry
  • establish priorities for further investigation.
DSC_0066-anita

Inquiry is about building knowledge and about regulating our learning.

We need to know what is important to focus on to meet our outcomes.

Determine:

  • What do we know now?
  • What do we just think we know? 

This section is intended to prompt thinking about the use of data when building educational partnerships through inquiry-based learning.

Selecting and analysing data

Research from What is the nature of evidence that makes a difference to learning? reveals many schools collect information about their students, but often they do not use the information to drive improvement.

Useful data helps teachers and school leaders to understand:

  • what students need in order to achieve outcomes that the school community has identified as important
  • where students stand in relation to national patterns of progress
  • in what areas students need support to catch up with others in their year group.

Collecting data in connection with less tangible (such as sociocultural and affective) outcomes is more difficult, requiring close observation and learning conversations with students, parents, and whānau.

Schools also collect data about teacher knowledge and practice, and they should be collecting information about their relationships with whānau.

The key to using this data effectively is to connect it to both data on student goals and outcomes and data about school-wide needs and priorities.

In deciding on the data to collect, schools need to take into account the aspirations of whānau and the knowledge and skills that they regard as important, including cultural knowledge, practices, and language.

Determine:

  • What are those aspirations?
  • What data do you need to collect to find out whether they are being achieved? 

This may not be the same across different Māori communities and whānau. Partnership begins by asking questions and listening actively to the answers.

Data collection and analysis

Ki te Aotūroa: Improving inservice teacher educator learning and practice is a set of learning materials that supports the Inservice Teacher Education Practice (INSTEP) project.

INSTEP identified three steps in the data collection process:

  1. Deciding what information is needed
  2. Choosing appropriate tools
  3. Using the tools.

The first step means that schools need to separate their data for Māori students and for specific cohorts of Māori students (for example, boys versus girls).

Then, organise that data so that all those with responsibility for student learning, including whānau, can access it and make sense of its implications.

Data becomes evidence when people analyse what it reveals about current beliefs and practices about teaching and learning.

This analysis requires more than understanding statistics – it means asking where students are, why they are there, and what teachers, leaders, and whānau can do, individually and collectively, to help them do better.

INSTEP further describes the analytical process as one of “making sense” of the data that has been gathered. This needs to be done within an analytical framework.

INSTEP describes three steps embedded within the critical analysis of data:

  1. Drawing initial inferences on the basis of our expectations
  2. Asking deeper, more complex questions in order to make sense of the data
  3. Making decisions about where to go next.

You can read the 2009Evaluation of the Inservice Teacher Education Practice Project (INSTEP). This evaluation report explains how INSTEP's contributions to bringing about shifts in knowledge, skills, and expertise.

 

ERO and data analysis

The Education Review Office (2011) describes data analysis in terms of three levels:

The first level of analysis is the gathering of raw or aggregated data. Some of the data will be quantitative/numerical and some will be qualitative/narrative. The data describes “what is” or “what is happening”.

The second level of analysis takes data and turns it into information. It allows schools and kura to make key statements or comparisons. It is used to inform people or planning. It describes “what is significant”. 

The third level uses this information as evidence to support judgements “how well/to what extent”, to make decisions “if this is so, then we need to …” and to decide priorities “the most compelling need is …”

page 10

Building confidence with data

Some people are uncomfortable with the process of selecting and analysing data. 

The Ruia exploratory study tells us teachers and school leaders should not be afraid of the data.

Instead, they should feel supported as they build their confidence in working with data and understanding what it is telling them about the next steps for them and their students.

Keep the data alive throughout the inquiry.

This means organising and storing so that it is easily accessible and enables students’ progress to be tracked.

Student management systems have evolved. Now, tracking trends and identifying patterns is a feature of these systems.

Use the to inform you about your students. For example, identify attendance patterns and which students are not attending.

After that, teachers, leaders, and whānau can collaborate and address the issue.

A good way of making the monitoring of progress more manageable for teachers is to select a small group of Māori students in each class as ‘focus students’ for more intensive tracking.

This does not mean that other students are ignored; in fact, experience shows that this raises teachers’ awareness of how their practice impacts on all their students.

School leaders who are committed to educationally powerful partnerships ensure that parents and whānau can use this tracked information so that they, too, understand their children’s progress and can participate in identifying their next learning steps. (Note, though, that it remains important to respect students’ right to privacy.)

Conducting inquiries

Although Ki te Aotūroa: Improving inservice teacher educator learning and practic (INSTEP) is intended primarily for inservice teacher educators (ISTEs), it includes a wealth of material useful for all educators, particularly for school leaders.

For example, a chapter on the practical aspects of inquiry examines each phase of the inquiry and knowledge-building cycle. The cycle is adapted for ISTES, but the big ideas that underpin it are true for all inquiry-based learning.

Of particular value are the links to cases from actual practice that illustrate ISTEs supporting teachers and school leaders to inquire into and improve their practice.

Return to top