Hi everyone,
I’m using the rotated sonic_u data from Andy Clifton, which I downloaded from the url on May 18th. It seems there are a lot of wind records that have at least one NaN, are not 12,000 elements long, or both. In most cases, there are NaNs for all 6 height locations in a given 10-minute period, but this isn’t always the case.
I have an m-file that will recurse through a specified data directory on your hard drive and return a cell with the date/time stamp, the quantity that is not “right” (i.e., Sonic_u_131m), and the error flag (1 = not 12,000 long, 2 = has one or more NaN values, 3 = both). If this is of interest to you, please message me and let me know and I’ll send it to you (apparently I can’t upload mfiles, and when I tried to upload a text file “the board attachment quota was reached”).
I’m not absolutely certain, but I’m pretty sure the NaNs come from the quality check that Andy does on the M4 data before sending it out - if the data are below the 95% quality level, NaNs are returned for the whole record. I don’t know why some records are still less than 12,000. As a reference, of the 1739 records I had available, 890 of them were flagged.
I unfortunately can’t attached a text file with the records that aren’t “right”, but here’s an example of the output after I saved the cell to a text file:
2012/10/12 00:10 Sonic_u_100m 2
2012/10/12 00:10 Sonic_u_76m 2
2012/10/12 00:10 Sonic_u_50m 2
2012/10/12 00:10 Sonic_u_15m 2
2012/10/12 00:30 Sonic_u_131m 2
2012/10/12 00:30 Sonic_u_100m 2
2012/10/12 00:30 Sonic_u_76m 2
2012/10/12 00:30 Sonic_u_50m 2
2012/10/12 00:30 Sonic_u_30m 2
2012/10/12 00:30 Sonic_u_15m 2
2012/10/12 01:10 Sonic_u_131m 3
2012/10/12 01:10 Sonic_u_100m 3
2012/10/12 01:10 Sonic_u_76m 3
2012/10/12 01:10 Sonic_u_50m 3
2012/10/12 01:10 Sonic_u_15m 3
2012/10/12 01:20 Sonic_u_131m 3
2012/10/12 01:20 Sonic_u_100m 3
2012/10/12 01:20 Sonic_u_76m 3
…etc.
