Module 2: check-lists; rating scales; milestones

Time:

What we do: in this module the structured observational tools are introduced. They are grounded in the logical way of thinking, in which different categories that characterise the nature of the events are identified and measured. Therefore, for each category (lunch; play; number learning, etc) of events, you can identify in advance all the characteristics that constitute all the examples of that category and then you observe if a specific characteristic is present/absent [they are called check-lists] or you measure its intensity through the attribution of a number [they are called rating scales].

Therefore, you can have structured observational tools (usually a printed grid) that present all the items you can observe in an educational activity, and a rating scale which allows you to attribute a numerical intensity to that characteristic. You then can compare the values you have attributed across children or events or sequentially across time.

 

Structured observational tools

The structured observation tools are constructed on predefined categories. A structured observational technique implies that every observation is conducted according to the same procedure, assuring that the data can be aggregated and the distribution of the unit of observation can be appreciated.

It is crucial to establish at the outset the relevant set of occurrences that are expected to observe and the coding scheme, that is the categories expected and the logic to assign each observed occurrence to a category. Therefore, categories must be mutually exclusive, that is each occurrence should be attributed to one and just one category. The set of categories should be inclusive, that is, should represent all the observed possibilities.

Check-lists are structured observational techniques in which the coding scheme allows only presence/absence of the occurrence of a given category in an observed event;

 

Date:

Setting

Duration of the observation

Child Name

Age

Task:

Object of the observation: the adult-child interaction in performing an activity

Observe and recognize the occurrence/non-occurrence of the following:

No

Yes

The adult performs the task and explains the actions to the child;

 

 

The adult performs most of the task and the child contributes for specific aspects of the performance;

 

 

The child performs the task and the adult helps by giving guidance in critical points of the performance;

 

 

The child performs the task and the adult poses questions to help the child to reflect and monitor her/his plan and procedures;

 

 

The child does the task and the adult comments at the end

 

 

 

 

 

rating scales are structured observational techniques in which a degree of intensity is given to each category (usually on a three- or five- point scale), therefore allowing for the recognition of the strength of the occurrence of a particular observed event.

 

 

Date

setting

duration of the observation

Child Name

age

Task: the child is asked to collect as many spoons in the box as many dishes are on the table.  The distance between table and box does not allow a simple perceptual estimation

Object of observation: child's counting ability

Only by physically pairing one object at time

tentative, for some amount

Yes, by counting separate sets

Elements of the counting ability

 

 

 

The child composes a one-to-one correspondence between two collections of objects

 

 

 

The child counts the collection of objects:

 

 

 

correct counting sequence

 

 

 

counts all the objects, each only one time

 

 

 

recognizes the cardinal value, that is, that the last number counted represents the numerical value of the collection

 

 

 

Counting and comparing two collections of objects: which is larger?

 

 

 

 

 

Learning Milestones

 

 

 

Milestones:

Milestones are explicitly stated for different stages of education. In the example, at the end of the EYFS, children are expected to count from 1 to 20; place them in order, recognize the different magnitude of numbers (which is larger? Which is smaller?). They also add and subtract and solve problems with numbers to model a given situation.

You can compose the portfolio of each child’ number competence by using a rating scale and/or with short narratives of the child solving a problem (for example by reproducing a disposition of a number of elements such as the sheeps in the example


It is useful to describe the process of the child’s problem solving.

-          Does the child bring a number of objects to make a perceptually visible one-to one- correspondence (without counting)?

-          Does the child count an array of objects (dishes) and then counts a number of objects (glasses) and then adjust the correspondence both by counting and making a correspondence?

-          Does the child count an array of objects (dishes) and then counts the same amount of another group of objects (glasses)? For which magnitude is the child able to rely only on counting?

-          Is the child able to understand which quantity is bigger by simply comparing numbers?

-          Is the child able to understand how many elements are needed to equalize two sets of objects (how many to equalize a group of 4 objects to 7?)

You may notice the children’s developing competencies by observing them in spontaneous activities of counting, or by creating a situation in which the numbers are part of the activity (for example, asking them to prepare the table for a playing lunch with dolls, or reproducing a display of toys (paring through looking at the two sets and then by counting).

For each observational tool, it should be defined the date of the observation, the setting, the task, the target child or interactional unit, the children’s ages, the period of time in which the expected unit of observation is manifested.

If a high degree of interpretation is required or if different observers disagree on the attribution of an occurrence to a category, the structured observation schedule should be reworked: Maybe it is to complex and the unit should be simplified; maybe the categories are ill-defined and should be reformulated.

 

Outcome: this module is intended to promote your competence in analyzing structured documentation tools, in recognizing that each gives focus to specific aspects of the educational process and that the practice is always more complex than the data incorporated by each tool. You may want to complement different tools to have a richer representation of some educational processes.

Structured observations allow the gathering of a great amount of data, from different observers and they support comparisons across time and settings.

However, they limit the shift of focus during the observations, hampering the recognition of more encompassing educational processes

 

Did you notice? the logical mode looks for what is common and generalizable among educational events. Did you notice that each model of structured observation has its specific focus of attention? Please, reflect upon each observational tool in order to recognize its privileged focus, the opportunities it offers to improve the educational practice, and its shortcomings, the relevant aspects of the educational process that are left outside its focus.

Task: apply one of the structured observation tools presented in this module (or use one available in your service) and reflect upon the results, in order to think about what you can change in the learning environment to promote children’s learning. Reflect also upon the tool itself: how could it be reformulated, in order to make some other aspects of children’s learning visible?