Jump to content

Photo

Configuring Tapestry for Analysis and Tracking


  • This topic is locked This topic is locked
No replies to this topic

#1 Lauren

Lauren

    Forum Inhabitant!

  • Admin
  • PipPipPipPipPip
  • 258 posts
  • Gender:Female

Posted 08 July 2016 - 09:59 AM

If you're intending to use Tapestry to track your children in terms of their attainment, progress, and the number of assessments you're making for each of them, there are a number of settings that we recommend you have a look at. These can be found in your Summative Assessment and Analysis sections. 

 

To find them, you first need to go to your control panel by clicking on your name and then 'Control Panel' in the top right hand corner:

 

2016-07-13_13-19-02.png

 

Now click on 'Settings' to get a list of further options. You will be able to see both of the options I mentioned above, but to begin with, just go to Summative Assessments.
 

2016-07-13_15-43-52.png

 

That will open a page that gives you several options:

 

2017-03-23_19-54-26.png

 

You will need to go through each of these options to make sure they're set up in the best way for you. 

The first option is about which observations are included in the score calculated for each child in their snapshots.

 

To get this score we average out the age band and refinements that have been made for a child in a particular aspect during the period but this option allows you to choose whether you want us to include only the published observations (in which case the tick box should be unticked), or the assessments made in unapproved observations too (in which case the tick box should be ticked). If you change the choice that has been made there, remember to press submit.

 

2016-07-13_17-16-32.png

 

The next section on this page is for your term dates. You can change these to match up with your actual term dates by clicking on the 'Change Assessment Periods' button. Please see this tutorial for in-depth instructions for that. 

 

2016-07-18_13-43-29.png

 

Next you can configure specific options for the EYFS and P Scales assessment frameworks. 

 

For EYFS, the first option is about whether or not you would like to include refinements in the snapshots. As a default, this option is set to include refinements. We recommend that you keep this option ticked because they will enable you to see the progress your children are making at a more in-depth level - a child may well stay in the same age band for several terms, so if when they joined you they were only just in the age band, and 8 months later they were still in it, but really securely, even though you know they've improved, the data suggests that they've stayed the same. 

 

The second option lets you decide whether you would like the colour coding in the snapshots to be based on the age band as a whole (in which case you would want it to be unticked), or if you would like it to account for refinements or not. This tutorial explains the difference in how that would then be calculated.

 

When first starting up Tapestry the default option selected for this calculation uses Age bands and refinements.

 

The drop down list option is about how you want summative assessments to be calculated. This is what you can choose from:

- Age bands only. Tapestry chooses the average (mean) age band from the assessments (made as part of your observations) for each aspect.
- Age bands and refinements. Tapestry chooses the average (mean) age band and refinement using the age bands and refinements from the assessments (made as part of your observations) for each aspect. We do this by converting each combination of age band and refinement into a linear scale (0-11 E = 1, 0-11 D = 2, 0-11 S = 3, 8-20 E = 4 etc.), averaging that and then converting it back into an age band and refinement. For assessments that don't have a refinement, we use 'Developing'.
- Age bands and statements. For each assessment (made as part of your observations), Tapestry turns the number of statements ticked into a refinement. Less than 1/3 of statements ticked is Emerging, 1/3 to 2/3 is Developing, and 2/3 to all is Secure. We then average these out using the Age bands and refinements method.
- Age bands, refinements, and statements. For each assessment (made as part of your observations), if there is no refinement, Tapestry creates one from the statements using the Age bands and statements method. We then average these out using the Age bands and refinements method.

 

 

2017-03-23_19-56-28.png

 

There are also a number of options for your P Scales settings. 

The first option is a tick box asking whether you would like the snapshots to include just the level, or also the percentage of descriptors that have been ticked. 

The second option asks how you would like the snapshot scores to be calculated.

The third option asks when you would like Tapestry to consider a level achieved in terms of the percentage of descriptors ticked.

If you change any of these from the default, just remember to press submit when you're ready for the changes to take place. 

 

2016-07-18_14-18-31.png

 

You can change the P Scales, EYFS, and General options at any point to see how the results you get in the snapshots section differ, and then change them back without losing any data. However, if you change the dates of the assessment periods then you will lose any manually overridden snapshots, so if you have started manually changing snapshot data, we strongly advise you to wait to change your period dates until a new cohort start with you. 

 

That's it for the Summative Assessment options, but you might also want to take a look at the Analysis options. To find that you will need to stay in the control panel, or go back there if you've left, then go to Settings > Analysis:

 

2016-07-18_14-37-02.png

 

The first option is the refinement threshold and affects the Next Steps section of Tapestry. If you have enabled refinements for EYFS assessments, you can choose the refinement (emerging, developing, or secure) at which Tapestry should start showing "Next Steps" for the age band above the current one. So for example, if a child's snapshot said they were 30-50 developing and the refinement threshold was set to secure, Tapestry would keep showing you the next steps for 30-50 until the child reached 30-50 secure. However, if a child's snapshot said they were 30-50 developing and the refinement threshold was set to developing, Tapestry would show the next steps for 40-60+. 

 

2016-07-18_14-39-53.png

 

This next section is where you can add/remove custom "Next Steps" for each aspect and progression.

To do this you need to first of all select an aspect that you would like to edit from the first drop down box

 

2016-07-18_14-51-45.png

 

Then select a progression from the second drop down list.

 

2016-07-18_14-52-47.png

 

Once you have done that, a new section will appear containing the current statements for your selection.  To add a custom statement, click on the "Add next step" button.

 

2016-07-18_14-54-59.png

 

A pop-up window will appear.  Type the statement into the text-area, then click the "OK" button.

 

2016-07-18_15-02-58.png

 

To remove or edit a custom statement, click on the "X" or the pencil to the right of the statement in the list.
 

2016-07-18_15-04-06.png

 

The Qualitative Ranges are for the overview graphs in the analysis section of Tapestry and control the colour coded sections - so what is trailing, satisfactory, and good (or whatever words you choose to use).

 

This setting contains 3 tabs for "Progress", "Attainment" and "Thoroughness".  Each tab works in the same way, and it is here that you can set thresholds for each qualitative range i.e. what does trailing mean in numbers. 

 

Progress:  The difference in attainments for a child across 2 periods. 0 means that they are progressing at the same rate as they are aging. A negative number means they are progressing at a slower rate than they are aging or that they haven't progressed at all, but it doesn't necessarily mean they are going backwards (although it can). For example, if a child was at 30-50 secure in January, and still 30-50 secure in May, they would have aged 4 months, but their attainment will have stayed the same so it's possible their progress will now say -4 (but it will depend on their exact age and if those extra 4 months have pushed them out of the age related expectation band). 
 

Attainment:  The number of months above or below their actual age that a child has been assessed as (this is calculated from the snapshot value. So if a child has been assessed as 30-50 Secure, we would expect them to be between the ages of 43 months and 50 months. If their actual age was in this bracket then we would say their attainment was 0. If they were 41 months old, we would say their attainment was 2 (because they are 2 months away from being in the 43-50 band. If they were 51 months old, we would say their attainment was -1. 
 

Thoroughness:  The average number of assessments made in an aspect for a child throughout a period (so the total number of assessments divided by 17). 

 

Click here for dedicated tutorial about what these three mean and how they're worked out.
 

2016-07-18_15-06-44.png

 

You can rename the ranges in the left hand column - for example, if you don't like the word trailing and would rather use 'aim to increase'.
 

Set Default Ranges:  sets all the thresholds in the tab back to "factory settings" i.e. no customisation.

Reset:  sets all the thresholds back to the last saved state i.e. undoes any customisation performed in the current session.

- :  removes the last threshold (in this case that would be 'Good').
+ :  adds a new threshold to the bottom of the list.  You can type in a title for it and set the minimum value that it starts from.  This will adjust the maximum value in the previous threshold, and the last threshold always has a maximum value of infinity.

 

In reality, setting a very rigid threshold may produce overly pessimistic or optimistic results as the rate of development can speed up and slow down in individual children, so you may wish to assess 'satisfactory' development with a buffer either side of their actual age e.g. +/- 2 months, rather than 0 - 2 months which you can see in the screenshots for this tutorial. You can change these values at any point, so if after you've been using Tapestry for a few periods, the colours you're seeing in the overview bar charts don't seem to reflect how you know your children are doing and what the quantitative scores reflect, then it might be worth changing the values here until they're more realistic. 

 

 

Make sure you press the Submit button when you're happy with the values you've selected. 

 


  • TWINGABLES likes this

Best wishes,

Lauren





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users