There are now new ensemble-mean files for tas, pr, and evspsbl. The two former have very small differences to the previous versions, whereas the latter should now be OK.
It is apparently only the CRU-interpolated HC monthly files that are upside down.
I have now successfully calculated and uploaded the corrected monthly-mean DMI_BCM files!
Dear all, please be careful with evaporation. I have looked at the evspsbl files recently, and I found that there are different sign conventions in use: Apparently
MPI, ETHZ and CNRM have it positive downwards, i.e., mostly negative numbers. ICTP, KNMI, DMI, SMHI and HC use the opposite convention, with mostly positive numbers. I have
not looked at the remaining institutes.
Note also a potential issue, depending on your software: NetCDF CRU-interpolated files from the HC start with high latitude and go south, in contrast to everybody else. The "lat" array is correct, and the files are consistent. But, if you blindly read data from several models, you may get errors!
These issues should of course be corrected. But, I am afraid that we do not have many human resources available, so I can guarantee that it will take some time. Good luck!
Regarding the redone DMI_BCM simulation, I am afraid that the monthly files had problems -They are identical to the old ones. The daily files should be OK, though. Next week
we should be there...
The last 15 years of the DMI_BCM simulation have now been repaired, and all files should be updated by the end of today. The ensemble mean files will be done shortly.
The units of evaporation, evspsbl, are wrong in the DMI BCM simulations. Possibly the same applies to runoff etc. We are checking this out and will replace
the files asap. The missing period 2085-2099 has been rerun, and we are postprocessing at the moment. This also means that the ensemble-mean evspsbl file
is very wrong; it will be replaced shortly. Apologies to everybody affected!
The erroneous ensemble-mean evaporation has been replaced. Sorry!
In the left menu I have added links to what came before us, the upcoming data archive of the CORDEX project. Once it grows, there will be an unprecedented amount
of data with many combinations of GCMs and RCMs, several RCP scenarios and a patchwork of areas covering all land masses of the Earth.
I have now finally removed the origional CNRM A1B and KNMI ERA40 simulations, which have been replaced by newer versions years ago. In case you need these data they
still exist on tape.
You can now download an evaporation ensemble mean calculated just like precip and tas as described under 24/6/2010. Note that the BCM model is still part of this in spite of the error mentioned 15/12.
I have made the quick-look analyses public for your information. I have also uploaded a document
describing the climate change signal of the ENSEMBLES RT3 simulations which reach 2099.
Note that the error-ridden HIRHAM5-BCM simulation is part of the note.
A serious error has been found in the DMI-HIRHAM5_BCM run: The period 208512-209912 cannot be used, since the insolation has been shifted by one month; boundary
conditions have not, so there is no alternative to a rerun. Our apologies!
There seems to be an error in the 50km-file SMHIRCA_A1B_ECHAM5_DM_50km_2091-2100_pr.nc.gz (gzip corrupted). It may take a while to regenerate it at the SMHI.
The DMI_BCM files for 1971-1980 lacked lon and lat. They have been fixed now.
A bit of smallish increments before the vacation: Some missing files from the SMHI HadCM3Q3 data sets are being uploaded right now. The new DMI BCM data now have interpolated
For my own, and possibly your, convenience I have constructed two files with interpolated monthly temperature
and precipitation for the period 196101-209911. They contain
pointwise monthly data for the ensemble mean of ICTP-REGCM3_ECHAM5, MPI-M-REMO_ECHAM5, DMI-HIRHAM5_ARPEGE, KNMI-RACMO2_ECHAM5, SMHIRCA_BCM,
DMI-HIRHAM5_ECHAM5, METO-HC_HadRM3Q0_HadCM3Q0, SMHIRCA_ECHAM5, ETHZ-CLM_HadCM3Q0, CNRM-RM5.1_ARPEGE, DMI-HIRHAM5_BCM in the area covered by all simulations.
These are the simulations going to the end of the
century. I have excluded the simulations driven by HadCM3Q3 and HadCM3Q16, which are not very realistic. The data for 209912 are bogus; this is
a copy of 206912, since not
all simulations included 209912 and I wanted an array with only full years for practical purposes.
Let me know if you find problems.
Be aware that the ECHAM5 GCM has driven the majority of these simulations, so the averaging is not "fair". Also, remember that each of the 4 GCMs have followed their own
trajectory from year to year. These fields only make any kind of sense if you look at longer-time averages.
Finally, not all md5sums files have been up to date. I am currently running a script that ought to take care of this, so from now on it really should be possible
to check whether your download was successful. If you forgot: Each and every data directory contains a small text file called "md5sums" with "fingerprints" of the
data files. At a linux system you can run "md5sum -c md5sums" to check all files, or you can run "md5sum downloaded_file" and compare the resulting
string with the content of my md5sums-file. This can be done under Windows as well, though I have no experience. Google came up with http://www.softpedia.com/get/System/File-Management/MD5-Checker.shtml.
The HIRHAM5 simulation by DMI driven by the NERSC BCM model is now available.
The SMHI_HadCM3Q3 data are now complete.
The SMHI_HadCM3Q3 simulation is being replaced at the moment. The new simulation has its own greenhouse forcing following the scenario, in contrast
to the former, where climate change only entered through the boundary conditions.
Once more I have had to restart the web server due to greedy users flooding the machine with requests. Sorry to the rest of you!
Two CHMI ERA40 25km hfso files have been replaced.
UCLM A1B tdps files were wrong and have been replaced. I have taken the opportunity to collect decadal MM files into files for 1951-2050.
I have had to restart the web server program, since a user at ethz.ch was using 46 of the 50 connections, hampering the net traffic of my entire
institute. As I have stated below, we do not allow more than 4 simultaneous connections from one IP address. As we have not yet implemented a proper
traffic control, I shall simply restart the server whenever I discover behaviour like this. I apologise to the rest of you!
Some further SMHI files have been added/updated: BCM-driven clt-fields and HadCM3Q3-driven ua700 and va700 as well as the file SMHIRCA_A1B_HadCM3Q3_6H_25km_2091-2100_hur1000.nc.gz.
In case you are not aware of what the Climate Explorer is: You can access not just ENSEMBLES and other model data, but more
importantly lots and lots of historical station data. And the user interface is several levels above what you find here.
More selected CRU-lattice fields from the METNO simulations are on their way. At the moment for the A1B BCM-driven simulation. More thanks to GJvO!
Some good news for once: We have received a 3rd party contribution from Geert Jan van Oldenborgh of KNMI Climate Explorer fame: CRU-interpolated
MM files for the important fields psl, tas and pr for the two METNO A1B simulations where we have been waiting for interpolated files for a while.
Dear Squall1, that is not what I meant! Anyway, you are not beating the record. You are only using 42 connections. Still, the idea of a penalty box
seems better and better.
Two persons downloading RCM data are now using the entire bandwidth of DMI, 188.8.131.52 and 184.108.40.206; this means that the server ensemblesrt3.dmi.dk
is causing delays for all my colleagues working at the institute.
One of the two heavy users is even an IP address which was blocked yesterday, and was allowed access again after promising
to behave. With a shattered belief in the universal good, I will now look into setting up a blacklist with a quarantine period, whenever I see a
user doing massively parallel downloads, something like more than 4 retrievals from the same IP. So: The easy way is to NOT use "download accelerators" at all.
Btw., squall1 is nothing. Our good friend 220.127.116.11 managed 46 simultaneous downloads out of a grand total of 50...
DAMN IT! New record: Somebody at squall1.zmaw.de now has 28 simultaneous downloads running. This is like the gold rush. Try to be a little less trigger-happy
to avoid server casualties! I assure you, there is plenty of bytes for everyone.
One of the "sinners" has informed me that a firefox plugin called DownThemAll silently starts multiple downloads. This probably applies to a lot of other applications.
Right now, with this extraordinary load on our server, I would like to ask you to check your own download method and be modest.
Otherwise a quiet morning here, it is sunny, and only 3 users are downloading; may be the spike yesterday was mainly due to the fact that we have had a very long downtime. With a bit of luck, you might be able to do a couple of simultaneous downloads in the
future. However, please restrain yourselves. Be polite.
For your information: Our server, which is also prudence.dmi.dk, is a dual processor linux machine running apache, with 22TB of RAID disks, which are almost full.
Our connection to the outside world goes through the line of our host, the Danish Meteorological Institute. This line has a capacity of 100Mbits, or around 1TB/day.
The last year,
the total ATTEMPTED
download from ensemblesrt3.dmi.dk has been a bit less than 100TB. In the same period the prudence archive has had a download of only 6.5TB, however
3.5TB of these in this month. You might want to print these data, but keep in mind that the stack of paper
would be around 5000 km in height, and would take at least 2000 years to print...
We do not know how large a fraction of these numbers are successful transfers; most of the time probably all of it, recently probably a small fraction.
Our record month was September 2009, where a user actually downloaded 22TB, i.e., the entire archive. This month until now has been quite busy in spite of all the
downtime with 10TB, of which half has gone to one user.
The current attempted use is close to the practical limit of the system setup that we chose. This means that it would be greatly
appreciated if you limited your downloads to what you need. Getting the entire archive and then throwing away what you do not need is a disservice to your co-users.
Remember OpenDaP; it may require a bit of work to start using, but it saves waiting time for everybody due to the decrease in bytes transferred!
Join the club, fog.ethz.ch. (18.104.22.168) with 14 simultaneous downloads.
I have also noticed that "Get ASCII" in OpenDaP does not always work. We are aware that the version on the server is quite old, and we will upgrade in due course. Meanwhile, apologies from myself and 22.214.171.124 who seems to have his/her quite own
interpretation of what an ensemble is: All OpenDaP data are downloaded in 4 identical versions... If you have not yet understood my message: If you don't get an
immediate reaction from the server, DO NOT click repeatedly, particularly in the OpenDaP interface.
We are up, but there is a tremendous load. This is again because some impatient users have several simultaneous requests, even several IDENTICAL requests running.
PLEASE only click the link once... I am talking to YOU, 126.96.36.199 at cpe.netcabo.pt, downloading 22 UCLM files at one time through OpenDaP, and to 188.8.131.52
(HERMES.fmf.lu.lv.) with 13 simultaneous HC data downloads...
The trouble continues. We apparently still have to do some trouble shooting, even though the information below still very much applies. I do apologise for this;
and I urge you all to start slowly when the server starts behaving as it should. -Otherwise it will be flooded again again.
PLEASE do not click a data link 100 times! PLEASE start with one download. I just restarted the apache server, and I had a glorious 9 seconds of accessibility before
the server was once more flooded. I know you have all been waiting for data, but we only have a limited capacity; and this capacity can not be increased from
one day to the next...
DEAR USERS, PLEASE READ THE FOLLOWING!
As you are probably aware, this archive has been having huge performance problems for a while. We now believe that we have found one reason, and this reason
is one particular user. I will give some details below, not to place blame, but to inform you all how NOT to do.
Somebody, a Mac user probably from Italy, has been using a download manager called iGetter to access data files at prudence.dmi.dk,
which is actually the same machine as ensemblesrt3.dmi.dk. This is of course OK. The problem is that this piece of software starts a number of parallel
downloads. The setup of this user started a number so large that we hit the ceiling of the apache server here, basically excluding the rest of the world.
It is probably not this particular user and program who is responsible for all the downtime, but he/she certainly has been a major part of the cause
this week. Please, all users, be aware that parallel downloads may give you better access time now; but you are in fact taking the bandwidth from other
users. Next time you will be the one unable to get through. So, be nice!
I have uploaded new MM files for the old CNRM_ARPEGE experiment.
I apologise for the intermittent hangs that a lot of you are experiencing. We have a software problem, which we
have not yet identified. If you experience a hang, you are welcome to mail me about it -Then I will restart the server software.
CRU-interpolated data have been added for the SMHI ERA40-run in 25km resolution.
An entirely new data set for the HadCM3Q3-driven SMHI simulation is being uploaded. An error was discovered in the earlier data set, related to the CO2-concentration during the run.
Errors have been found in the two files CHMIALADIN_CY28_ERA40_DM_25km_1961-1970_hfso.nc.gz and CHMIALADIN_CY28_ERA40_DM_25km_1971-1980_hfso.nc.gz
I have taken down the page "outstanding data problems" as it has been hopelessly out of date for a long time. It will be revised and put back up again.
Two corrupted KNMI files have been replaced: KNMI-RACMO2_A1B_ECHAM5-r3_24H_25km_2001-2010_zg850.nc.gz and KNMI-RACMO2_A1B_ECHAM5-r3_6H_25km_1971-1980_zg1000.nc.gz
Corrected SMHI ERA40 files are on their way.
CNRM files are currently being repaired wrt. the format of monthly time variable (see below, 14/1/2010)
There was an error in the matrix table regarding the C4I simulation driven by ECHAM5 according to the SRES A2 scenario: It follows ECHAM5 ensembles member 1 and not member 3,
which is the standard one used for the A1B simulations; the control period of the ECHAM5 simulations
use historical emissions and are therefore the same for different future scenarios, but are different for different ensemble members.
This means that the control period 1961-2000 of the C4I simulation is NOT identical to the control
periods of the A1B simulations.
The corrupted file SMHIRCA_A1B_BCM_DM_25km_2051-2060_prls.nc.gz has been replaced.
I have uploaded even more GKSS_IPSL files now.
From the GKSS I am uploading mrros mrsos and mrross files. From the CNRM I am uploading CRU-interpolated MM files. More will be coming shortly.
Take care with CDO. I have been told that there is a serious problem when using the MPI tool CDO to handle monthly mean (MM) files, and have just
realised how serious it is.
Frequently, the files
in this archive have their time unit as "months since 1950-01" with type "float" or "double";
and frequently e.g. the first month of 1950 would have the value 0.5 to indicate that
it is centered in the middle of the month. However, CDO assumes that months would be of type integer and "solves" this problem by rounding.
This means that a value of 0.5 would be
rounded to 1, and it being interpreted as February 1950. This is only a problem (as far as I know) for the CDO tool and for files with floating point
time coordinates with half-integer values. I am currently about to correct this for CNRM, but there are lots of these files around, so it will take a long time
to convert the time coordinate of monthly files to integer type.
The existing GKSS A1B files have been corrected now. Two files had errors: GKSS-CCLM4.8_IPSL_24H_IPSL-50km_1991-2000_mrso.nc.gz and
GKSS-CCLM4.8_IPSL_24H_IPSL-50km_2001-2010_zg200.nc.gz. They will be replaced when the second batch of files arrives.
Do you know by heart what a Rockel-box is? If not, look here. These European sub-areas have been used both in PRUDENCE and in
ENSEMBLES for model intercomparison.
I forgot the link to the CHMI AMMA-region A1B simulation. It is fixed now. I am still uploading files to this directory! You better wait a day.
Happy new year to everyone! In collaboration with Burkhardt Rockel I have been correcting GKSS A1B European data, which had several problems in attributes
and time coordinates as well as in the file name syntax. Unfortunately further errors were discovered in the middle of the processing. Therefore, this directory currently
contains two kinds of files: Some with old file names and all errors, some (placed in directory "temp")
with new file names and most errors corrected. All fields are correct! We are only changing attributes.
In the near future, hopefully within this month, I will correct the files. I hope you can live with the inconsistencies in the mean time.
From the MPI we have retreived: Corrected files with hur1000 hur700 hur850 hur925 ps zg1000 zg500 for the 2071-2080 period
hus300 for the 1981-1990 period (AMMA/RT3),
monthly-mean data on the CRU-grid for AMMA A1B, and daily data for the year 1950 for AMMA A1B.
METNO A1B MM data have arrived.
CHMI AMMA-region A1B data are almost there now.
There is some variation in the starting dates of these AMMA-region transient simulations. To help a bit I have added starting dates to the matrix.
The data mentioned below are complete now on the server.
The MPI have sent a disk with climate-change data for the African region. These data are being uploaded now and ought to be there tomorrow.
The INM have also provided CRU-interpolated files now, both for the European ERA40-runs and for the AMMA runs. They should be up soon.
The first gift in the advent calendar contains AMMA-region A1B data from the INM, driven by HadCM3Q0. The data are still being uploaded, so take care!
Now we have European A1B output from GKSS: CLM driven by the IPSL model.
Also the MPI have delivered: REMO over the AMMA region driven by ERA-INTERIM.
NOTE that we now also have an AMMA-region matrix online (move your eyes a bit to the left).
Dear colleagues, good to see you again in Exeter!
You now have access to a new CNRM ARPEGE-driven European simulation. In contrast to the old one (still there) it goes to 2100, and it uses a different ARPEGE
Also GKSS data are now accessible. This is the AMMA-experiments, both ERA-INTERIM and ECHAM5-driven climate change.
There are new and correct maximum and minimum fields from the ICTP (see below, 7/10).
I am uploading AMMA data from the GKSS, both ERA-INTERIM and ECHAM5-driven. Also a new CNRM European A1B simulation
is being uploaded. This simulation goes to 2100 and uses an updated model version. I plan to keep the old version and rename it
when the upload is complete.
We shall have to reboot the server at 13:00 CET. Sorry for your inconvenience!
We have received AMMA-region ERA-INTERIM data from the Hadley Centre. Please use the portal link to the left for access.
A small (?) error has been found in all DMI data sets: For the fields prc, prls, pr, prsn, tauu, tauv, hfss, hfso, hfls, rss, rsds, rls, rlds, rst, rsdt, rlut, mrros,
mross, mrro, mrso, as, prw, clwvi, clivi, wss, mrso, mrsos, tso, mrsos (basically all fluxes plus 10-m wind, albedo, soil fields) there is a normalisation error in every
first value in each month. -One extra 10-min time step was included without proper normalisation, so you can get very close to correct values by multiplying the value by period_length/(period_length + 10min).
This also applies to monthly averages.
The ICTP has found a postprocessing error in all daily max and min fields for the A1B European and the two AMMA runs, i.e., not for the ERA-driven European runs.
The fields have been deleted now, and new corrected fields are expected in a week or so. Sorry for your inconvenience.
Sunshine duration (sund) in all the DMI-HIRHAM output was given in the incorrect units (hours as opposed to seconds). This has now been corrected.
As you may have noticed, we have been down since Saturday. The reason was a power failure at the DMI. We only discovered its consequences for the web service yesterday,
and we were quite lucky that no hardware seems to have been damaged. To my knowledge everything is up and running again, so PLEASE let me know if you experience
The error was worse than I thought. I am afraid that the DMI hursmax and hursmin cannot be used and cannot be recreated... Thanks for the help, Pascal.
An error has been found in all DMI files with maximum and minimum relative humidity (hursmax, hursmin). They are off by a factor 600 (the time step in seconds :-( ). So, please
divide the values by this number, or wait a few days until we have fixed the files. Sorry about this.
Two new data sets: ICTP AMMA-region ERA-INTERIM and UCLM AMMA-region driven by HadCM3Q0. Enjoy!
The SMHI have discovered some errors in their European simulations and are redoing them currently:
Due to an error in the treatment of SSTs/sea-ice from ERA40 in the
Rossby Centre RCA3-simulations at both 50 and 25 km sea-ice coverage
is overestimated (always 100%) whenever the SST in a grid box is below
-1.8C. Consequences of this error are too low air temperatures in
some oceanic areas during some years.
An error in SSTs close to the 0 degree meridian for a few decades
has been detected in the Rossby Centre RCA3-simulation with HadCM3Q3
on the boundaries. As a consequence the annual cycle of temperature is
too small during the period January 1982 until November 2029.
Fixed the missing link to the European METNO downscaling of HadCM3Q0. Sorry!
We have received new tdps files for the SMHI A1B European simulations.
We are uploading A1B AMMA-region data for HadRM3P driven by HadCM3Q0.
So, now we have corrected UCLM files plus AMMA, we have METNO AMMA runs for both HadCM3Q0 and ERA-INTERIM as well as a voluntary HadCM3Q0 RT2b run.
Back from vacation I found disks from UCLM and METNO. Expect new data soon...
I have been informed that the OURANOS prhmax fields have the wrong units: 50km data ought to be divided by a factor of 4, and 25km data by a factor of 6!
ICTP AMMA A1B data are being uploaded at the moment. Should be complete by the end of the day.
The SMHI AMMA A1B files were erroneously labeled "HadCM3Q1" The correct driving model is HadCM3Q0. The names (and only the names) have been replaced.
The UCLM have found a serious error in their AMMA data; please be aware of that! These data are removed now, and new data should be available at the earliest in mid July.
Results from the DMI AMMA region experiments are online. ERA-Interim data are complete, but A1B is missing the decade 2031-2040. This is currently being reprocessed and should be up by the end of the week.
The DMI-ECHAM5 results (including CRU-interpolated) are now all on the server.
There are updated CRU-interpolated files from C4I for all their experiments.
The DMI results driven by ECHAM5 are finally available (currently being gzipped in-place). For the moment being only up till 2050; the rest should be ready within a week.
AMMA-region ERA-INTERIM data from INM are now online.
The VMGO scenario run was put in the wrong place in the matrix. It has been driven by the normal-sensitivity HC experiment HadCM3Q0. Sorry!
The ENSEMBLES and PRUDENCE RCM databases are now accessible via the KNMI Climate Explorer! Many, many thanks to Geert Jan van Oldenborgh!
The data are accessible as "External data". Obviously, the ENSEMBLES and PRUDENCE data policies are still in force if you access the data this way.
For now it is only the monthly-mean data that are available. But via this connection you are able to do all sorts of data manipulations and analyses, which have not been
implemented on this web site. Good luck!
We now have ERA-INTERIM runs over the AMMA region from SMHI.
Dear friends, today the first AMMA-region data have come online. The West African data, both driven by ERA-Interim and by ECHAM5-r3 are available for the KNMI RACMO model.
Furthermore, KNMI has made four (4) further 50km A1B simulations over Europe available to us. They are driven by ECHAM5-r1, r2 and r3 and by the MIROC model; note that ECHAM5-r3 is the
reference ensemble member. Whether we will
have space to keep the latter data when the rest of the AMMA-runs come in, is not clear to me at the moment.
We now have the VMGO A1B data ready. Thanks!
All METNO MM-files of accumulated variables (evspsbl, mrro, prc, prls, pr, prsn, sund) had a wrong scaling. They have now been replaced.
The ICTP A1B data are now available. Some time tonight, you will also be able to find all the SMHI HadCM3Q3-driven data.
The HadRM3Q3 and 16 output data are now all available.
The SMHI ECHAM5-driven run lacked a few interpolated MM files. They are there now.
The ICTP transient data are being uploaded at the moment.
SMHI data driven by HadCM3Q3 will be there in a few days.
The ARPEGE driving-model data residing in the CECILIA directory (see 16/2/2009) now has FIX fields.
There were errors in the CRU-interpolated DMI snw files, in that the oor-values were wrong. They are being corrected now.
The backlog of data is being uploaded. We now have SHMI data driven by the ECHAM5 global run. Also, the Environment Canada data have been replaced.
The HadRMQ3 and Q16 data are in the process of being uploaded, but this will not be complete until next week.
I have today received a disk from ICTP, and I am in the process of preparing data from the Voeikov Main Geophysical Observatory of St. Petersburg. Hopefully
they will be up soon; the VMGO data will probably not be entirely complete for around a month, though.
DMI snow amount (snw) and snowfall (prsn) have been corrected, so they should both now be in the correct units.
Rejoice! The new disks have been installed now. Currently, the SMHI ECHAM5 data and the HadRM3Q3 and Q16 data are on their way up.
Also Environment Canada ERA40 data are being replaced: The daily and sub-daily fields used to be interpolated to CRU; now they
are being replaced by native-grid data.
We are working on the setup of the new disk array. Hence the server will be rebooted intermittently, probably over the next couple of days.
Sorry for the inconvenience! -But look forward to the Russian VMGO simulation, revised Environment Canada ERA-data, the SMHI ECHAM-driven simulation
and the HC HadRM3Q3 and HadRM3Q16 data as well as some revised HadRMQ0 files...
The revised AMMA-domain files with orography and land-sea fraction are ready now.
I have changed file- and field-names for the HC monthly-mean files called tsmax. They were actually ts! Daily files are what they claim.
The new disks have arrived. We still need to install them and put a file system up, but it should not be long now!
I have updated the participant list slightly. Any comments from participants are appreciated.
The combination matrix of which regional models will downscale which global simulations can now be accessed from the left menu. Numbers in parentheses indicate
the expected delivery date for data not yet in the archive. Thanks, Philip!
For project participants, the talks of the Toulouse meeting are now available here.
For consistency, I have renamed all the C4I A1B files, since the driving GCM is the HadCM3Q16 high-sensitivity simulation.
From Tido Semmler at C4I we have received a bundle of validation plots versus HOAPS satellite data. Project participants can follow the link in the left menu.
The DMI runoff files are being repaired at the moment. From tomorrow all DMI mrro and mrros files should be OK.
I forgot to tell you that all HC monthly mean files called tsmax actually contain average surface temp, i.e., they should have been ts instead of tsmax.
I believe that daily files are OK.
I have received data from Environment Canada and from St. Petersburg Geophysical Observatory as well as additional fields from the Hadley Centre.
Unfortunately the new disks have not arrived yet, so I am not able to upload the data. Sorry about that!
I did a bit of conformance checking. As a result the files from METNO have been renamed: Underscores between field name and level have been removed,
replacement of "_" with "-" in year ranges (e.g. 1961_1970 -> 1961-1970 ).
The errors mentioned 20/2 have been corrected now.
However, another further different error has been discovered in the DMI data sets: What we thought was surface runoff in the model was actually total runoff. This means that
the current mrro files actually contain 1xsurface runoff + 2xdrainage. The mrros files contain the total runoff; the mross files, correctly, contain
deep drainage. I will replace the files shortly.
A multitude of small errors are in the process of being corrected for all DMI data. The time and time_bnds variables are being corrected and turned into type double.
Most files had an error in the rotated_pole attribute, where the latitude and longitude were interchanged.
Errors have been found in some of the BCM-driven SMHI data. One batch of corrected files has been uploaded, more corrections are on their way.
The good news: The ARPEGE data that have been driving some of the RCM climate change simulations are now accessible. Please look in http://ensemblesrt3.dmi.dk/data/CECILIA/CNRM
The bad news: I have made a mistake in ALL DMI data files: For the native-grid files, the rotated longitudes and latitudes have been interchanged. And for the CRU-interpolated
files I still have a rotated_pole attribute -even the erroneous one... I shall start correcting them
in a little while... The projection is in reality obviously the normal: Rotated longitude at -162 degrees and latitude at 39.25 degrees.
It has been reported that the new SMHI BCM-driven data is written in the
compact netCDF form that includes an offset -and that the offset is not to be
found in the file.
So, take care while this is being checked out!
The DMI monthly means seem to have an error in the time coordinate. The 480 months cover 196101-200012. Sorry!
It has been reported that the METNO and DMI snow cover data (snw) may be in the wrong units (m of water, and not kg/m^2; should be multiplied by 1000). This is still
to be investigated; take care!
The ICTP have found a serious error in their A1B ECHAM5-driven simulation. Therefore the data have been removed.
From SMHI we have received and uploaded a 25km simulation driven by the Bergen Climate model. Enjoy!
KNMI have provided new metadata-descriptions. The new main reference for RACMO should be
Meijgaard, E. van, L.H. van Ulft, W.J. van de Berg, F.C. Bosveld,
B.J.J.M. van den Hurk, G. Lenderink, A.P. Siebesma, 2008:
The KNMI regional atmospheric climate model RACMO, version 2.1. KNMI
Technical Report 302, 43 pp. Available from KNMI, Postbus 201, 3730 AE,
De Bilt, The Netherlands.
Plots of the KNMI 25km surface fields can be found here.
We have received and uploaded daily minimum and maximum temperatures for the ICTP ERA40-simulation now!
-In contrast to the other HC-driven runs, the C4I time and time_bounds variables seem to be an unhappy mixture of Gregorian and 360-day numbers.
The C4I HC-driven climate change runs apparently have the wrong calendar attribute. Please be aware that the HadCM3 and hence all RCMs driven by that use 360-day years.
The RCM data archive has now been opened to the public! Enjoy!
You will have to follow the ENSEMBLES data policy. We would like to keep track of the users by asking for an email
address; this is not yet in the scripts, but you will be asked explicitly shortly.
The DMI data are now complete, including CRU-interpolated fields.
I apparently misunderstood something about the corrected METNO fields: It is all data that are affected, not just the period I mentioned below. All
Feb. 29 field values were 0.
I apparently made an error when trying to upload the repaired HadRM3Q16_CTL_ERA40_MM_25km_pr.nc.gz -It should be OK now.
The ENSEMBLES consortium has now agreed upon a data policy. This basically means that the data will be open to
all sorts of use, provided that you mail me any publications that build on these data.
We will remove the password protection, as soon as we have figured out how to force you to have agreed upon the policy before downloading data -Today or
tomorrow, I reckon.
The DMI data are now complete on the server, both the A1B CNRM-driven run and the replaced ERA40 25km run.
Happy new year to all of you! One of the New Year's promises we all made was to have our data ready on the server now. I am very happy to announce
that the DMI has more or less made it: The A1B data are ready now, and the new 25km ERA40 data are being uploaded and should be complete in a couple of
days. NOTE that all directional winds (ua's and va's) are wrong in these data sets -I shall remove the files shortly.
Also the new UCLM files are complete now. Thanks!
The DMI ERA40 25km data are being replaced now by a version with somewhat fewer bugs.
There are new UCLM A1B data being uploaded. Unfortunately they are a bit delayed at the moment due to software trouble.
I have finished uploading the METNO data.
Some OURANOS files have been renamed to be consistent with the rest of the archive (e.g. tso_1 changed to tso1 ).
The DMI A1B data are slowly being uploaded. DMI ERA40 data will be replaced by newer bug corrected data before Christmas.
I have received new data from METNO for the decades 1951-1960, 2001-2010 and 2041-2050 for their A1B simulation. They are being uploaded at the moment.
The OURANOS data ought to be complete now.
The OURANOS data are up. Unfortunately some DM files 1991-1995 are still missing, due to a corrupted tar-file.
Due to a script from the ETHZ, the ERA40 ETHZ MM-files now have a correct time array.
The new OURANOS ERA40 dataset should be complete in a few hours.
MPI A1B CRU-interpolated MM files were mistakenly put in a subdirectory. Now the are located where they belong. Sorry!
I have put up repaired CRU-interpolated monthly tas files for all three C4I experiments.
A clarification: Note that the CNRM boundaries used as the driving data of the ALADIN simulations (CNRM and
CHMI if any) as well as of the DMI simulation are ARPEGEv4.5 (stretched grid as in PRUDENCE), which can be accessed through the CECILIA database
also located on this machine and. It is NOT the CNRM-CM3 RT2A simulation of ENSEMBLSES.
HadRM3Q0 data are now uploaded until 2100. On the other hand the HadRM3Q3 and HadRM3Q16 A1B simulations now only has tas, pr, and ps files available due to our filled
disks. Sorry for the inconvenience!
DMI ERA40 25km data will be replaced in the near future.
ETHZ A1B files 2051-2100 will be there shortly.
Remaining OURANOS ERA40 data are being uploaded.
The EC data set now has FIX fields as well.
The DMI A1B data for 1981-1990 have been replaced, as a couple of months were missing from the files.
UCLM has delivered a number of corrected ERA40 fields, which are being uploaded at the moment. If you discover further
fields with errors, please let me know.
There has been some problems in the UCLM data, where buggy and fixed files were mixed. I will upload corrected files shortly.
The HadRM3Q0 data have been extended to 2100 now.
We have received MPI CRU-interpolated MM files.
The file METO-HC_HadCM3Q16_CTL_ERA40_MM_25km_pr.nc.gz was broken and has been replaced.
More DMI A1B data are being uploaded.
We have a problem: Our disk system is filling up at the moment, and it will take some time to get a new set of disks. It will probably be at least a month
until we have a solution. In the mean time I shall have to temporarily remove some data in order to make room for other sets. My plan is to
put the high- and low-resolution HC runs, HadRM3Q3 and HadRM3Q16, offline except for the a few fields (tas, pr, ps). These runs are voluntary contributions, and they take up a lot of space. I have these data on an offline disk, so they will be put up again as soon as the extended disk system is available.
From the HC we now have all 3 HadRM runs up to 2050. The holes mentioned below (3/10) are still there. We have also received data from the
3 driving HadCM3 runs now!
We have received CHMI CRU-interpolated monthly files now. There are also a bit more DMI A1B files.
I would like to bring a few obscure but important facts to your attention that have been a bit hidden on this web site:
Not all models follow the Gregorian calendar! -Everything driven by HadCM3 will have 360 days in all years (30-day months). The OURANOS
simulations ahve 365 days in all years. I believe that the rest of simulations use the Gregorian calendar, i.e. leap days every 4 years except for the year
The common integration area which is used by all RCMs except UCLM and ICTP (who use a Lambert projection) as well as INM is described here. If I remember correctly, some RCMs use a superset of this area, but all points in the description should be there. This area
is completely inside the buffer zone.
Note that e.g. the westernmost edge defines the center of the westernmost grid points, not the outer edge.
The CHMI ERA40 monthly means of tas have been replaced by corrected files.
I found an OpenDAP configuration error, which may have caused the OpenDAP users problems, since it basically
did not allow simultaneous users. The error would have been "Error building the DODS dataset query form" when trying
to get the access form.
There are more HC data on their way. I have been informed that there are some incomplete files on the server,
which will be corrected shortly:
"Some 6H data are incomplete, so far I (i.e., Erasmo)
HadRM3Q3: 1951-1960 zg1000
HadRM3Q0: 1991-200 hur1000
HadRM3Q16: 1971-1980, zg500,zg1000,hur1000,hur925,hur800,hur700;
The ETHZ ERA40 50km wss and wssmax fields have been updated due to a problem with one date.
The UCLM have sent CRU-interpolated monthly files, and repaired files that included the buffer zone.
The first decades of the DMI ARPEGE-driven A1B simulation are being uploaded at the moment.
-And now the HC simulations are linked in the table.
There are now 3 different HC A1B simulations with the different-sensitivity models. We have the period 1951-2000 currently
and will get the rest later.
The OURANOS A1B upload is complete. But the ERA40 simulations are being replaced due to a bug. Note that the new
simulation is with a slightly upgraded model version, but we replace the data anyway, since the bug (which is not
in the A1B simulation) made the first data set more different than the new one. This upload is under way, and the
last part of will take some weeks to get here.
The lat/lon problem has now been corrected for all HC files.
A large part of the SMHI A1B files were corrupted. They have now been replaced.
Good news and bad news: The OURANOS A1B data for the period 2016-2050 are being uploaded at the moment. However, this means that I have to move the directory between partitions. So very few of the OURANOS A1B data are available at the moment. It should be complete in a couple of days.
INM have found errors in their precipitation files. I have replaced INMRCA3_CTL_ERA40_DM_25km_1961-1965_pr.nc.gz and INMRCA3_CTL_ERA40_MM_25km_pr.nc.gz (Tido: Also on your disk).
Erroneous rotated pole coordinates in DMI and met.no file headers have been corrected.
The Hadley Centre have sent interpolated monthly means.
I have received ERA40 data from Environment Canada, which are now online. Enjoy! -Note that the results have been
interpolated to the common grid.
There are corrected MM files from the UCLM 25km ERA40-experiment.
We have received extra 25km HC ERA40 runs with the high (HadRM3Q16) and low-sensitivity (HadRM3Q3) versions of their model system. NOTE that the existing HadRM3Q "normal" files have been renamed with the prefix METO-HC_HadRM3Q0.
There are now interpolated MM files for the old HadRM3Q0 run. For the new runs there are currently ONLY interpolated files for monthly averages. Native-grid files will come later this summer.
A new experiment has arrived: The ETHZ simulation driven by the Hadley Centre HadCM3Q0.
The UCLM A1B data have not been accessible due to an erroneous link. Now they should be OK. I have also uploaded some
corrected precipitation MM files for the UCLM ERA40 run (sorry for the delay).
The METO-HC ERA40 files with interchanged lat and lon coordinates have been corrected for FIX and MM.
The ICTP land-sea-mask files had errors in the coordinates and a wrong mask over the Black Sea. They have
been corrected now.
There were errors in the MPI interpolated MM-files. They have been replaced now.
The UCLM, CHMI and MPI data are online now. I have (finally) updated the "Outstanding data" document -You may
disagree with its contents, so have a look. It still remains to check the list of fields in the archive against
file name inconsistencies.
SMHI CRU-interpolated fields have been uploaded.
UCLM A1B data are being uploaded at the moment, and new CHMI and MPI data are under way.
I have introduced the "missing link" to the C4I HadCM3-driven A1B simulation.
For participants, the Trieste meeting minutes are here now.
Several SMHI files have been updated with "standard" time coordinates.
I have received several complaints about the fact that a lot of files (from C4I, CHMI, MPI and SMHI) could
only be read with netcdf versions at least 3.6. I have now converted SMHI ERA40 data using ncdump and ncgen.
Hence, these files are supposed to be readable with netcdf3.5 now, but should otherwise be exactly the same.
If you look at these files and see any changes, please let me know immediately; currently I have taken a backup
of the old versions, but this takes up a lot of space and will not be forever. I will let you know how this
task goes on -it takes a lot of computer time, but very little human time.\
METNO monthly means of water fluxes have an error: The normalization with number of days per month has not
been done, so please divide by the relevant number of days. Corrected files will come!
The missing CHMI 50km FIX files are now uploaded. Revised SMHI files will be uploaded shortly.
We now have several updated INM files with various corrections; CNRM MM files (currently being uploaded) with the common interpolation method (very small changes!),
and I have started the very long and tedious process of converting netcdf3.6-only files to something that
netcdf3.5 understands. I have started with SMHI (ERA40) files, and will continue with MPI, CHMI, and C4I. These
are the institutes with this kind of files, as far as I can see.
The MPI A1B data for 2071-2080 had size 0. This has been fixed now.
LOOK LEFT! We now have Philip Lorenz' quick-look plots available. Thanks!
Due to a slight naming mistake in the new files you may still have downloaded faulty UCLM data for 1981-1990. They are OK now.
We have received a disk from METNO. The Norwegian ERA40 data now have monthly means (MM files). We are currently
uploading their RT2B experiment driven by the Bergen Climate Model -The link will be there in a day or two.
We now again have OURANOS A1B data, up to 2015. Also, their ERA40 rsdt data have been corrected.
The MPI and C4I data are up now, as well as new UCLM data. New KNMI mrross and clwvi files will be up today as well
as updated tasmin and tasmax fields from ETHZ.
The restore operation was not perfect, it turns out. The entire OURANOS climate change experiment has disappeared and
will have to be transferred again. Also, some MPI ERA40 data seem to be missing; these files are actually present, but some
of them are in two versions. The latter should be sorted out quickly, but take care in the mean time.
It would be prudent if the ensemble of institutions checked the integrity of their archived data 8-(
The faulty file /media/data1/ensemblesrt3/data/ERA40/CHMI/25km/6H/CHMIALADIN_CY28_ERA40_6H_25km_1971-1980_zg500.nc.gz has been replaced. The MPI data are complete, and the C4I data are being uploaded.
Happy New Year to everybody! Finally the archive should be back to the status it had before we changed disks. PLEASE let
me know if you find anything amiss! Currently I am uploading the MPI/ECHAM5 RT2b data. C4I is waiting in line and should become available next week.
The site is up again, but be aware that the restoration of data will last at least a week. Apologies for your inconvenience.
Some time today we will take the data archive offline in order to install new disks. The restoration of the data from the
DMI mass storage will take at least a week. This means that the links will be there, but you may not find the data
you are looking for. I apologize for your inconvenience, but there is no way around installing larger disks with the
amounts of data we are continually receiving.
We have received an SMHI A1B transient simulation in 50km resolution based on ECHAM5. Thanks!
We have now ordered an upgraded and larger disk array. We will replace the 16 500GB disks with 16 1TB disks, hence
doubling the capacity of the RAID array from 6TB to 12TB.
In other words,
the entire database will need to be restored from mass storage afterwards. The installation will be done some time
between Dec. 16 and Christmas, and the upload time will probably be around one week, during which you can not be
certain that a particular file will be in the archive. So, plan ahead!
As you see, the site has been slightly modified. The relevant status documents from Prag have been put up on the left. Partners, please comment!
We have received supplementary sftls files from HC. There seems to be a common problem with HC files that longitude and
latitude have been interchanged. This will be corrected in the future, but will take some time.
We believe that we have now successfully upgraded everything after a day with various errors.
Please report to me if you have problems FROM NOW ON.
We successfully upgraded the kernel, so that we now have 2 CPUs. Unfortunately the RAID array is not recognized, which means that only 2TB data are accessible at the moment. We are working on this!
We shall have to take the server down this morning due to a kernel upgrade.
If you have not already seen this: The DMI 25km simulations has some serious errors in points with non-zero glacier
fraction. I will leave the data as they are until we have a chance to rerun the simulation.
4/10/2007 again somewhat later:
We had to take the machine down again, but still without positive results. It should be a couple of days before
it will become necessary again. Sorry for broken downloads and other inconveniences!
4/10/2007 a little later:
Sorry for the downtime. Our BIOS did not accept the new CPU, so we shall have to do it once more in the near future,
I am afraid. In the mean time the system continues as it was.
We will have to briefly take the system down, since we are installing an extra CPU. Hopefully the system will be more
responsive after that.
We now have quite a lot of data from the transient 1950-2100 (!) ECHAM5-driven KNMI experiment in the archive.
I found errors in the DMI MM-files that are based on sub-daily data. They have been corrected and uploaded. Also
monthly means of the DMI 50km run are available now.
The monthly means of the DMI 25km runs are now complete.
The ICTP, HC and UCLM data are there now. This means that deliverable D3.1.5 is now complete with all RT3 ERA40-based simulations online. Congratulations to us all!
I have started the uploads of ICTP and HC data now. There will also be replacements of many HC 50km files. Erasmo's list of corrections:
- Data with wrong grid info in the header:
wap, ua and va (all levels), wss, wssmax
- Data in incorrect unit:
rh (all levels), hurs, hursmax, hursmin
- Incomplete timeseries:
- Wrong value of mdi
mrsos (all levels), tso (all levels), evspsblpot, hfso, mrso, mrros,
mrross, sic, tsi, as, clisccp (all levels).
Also from UCLM I have received a disk. All 25km data will be replaced, and for the 50km data the following:
- 24H: tso1 for the first decade. It was
our first submission.
- 6H: 8 files, corresponding to 500 and 1000 hPa
Two missing months in the DMI 25km data have been filled in (199401 and 199403).
The monthly means are being calculated and uploaded. The missing data sets
from HC and ICTP have arrived and will be uploaded in the near future.
The Danish 25km data are being uploaded at the moment and should be online tomorrow. The link to the Ouranos data was broken, but is now fixed; note that the
geopotential height in the Ouranos data is in units of dekameters, i.e., 10 times too small in numbers. This will be fixed in a while.
With a bit of a delay from my side the INM 25km ERA40 data are being uploaded now.
The CNRM wind speed error is now corrected. 25km ERA40 data from UCLM as well as RT2B data from CNRM are being uploaded at the moment
and will be available shortly.
The annoying error that the data were not password-restricted is hopefully solved now. Tell me about any problems!
Some erroneous MM files from ICTP have now been corrected. I have forgotten to tell that there is a factor of 2 error in CNRM wind speeds (not ua and va). They will
There are data from our Canadian friends of Ouranos now. Thanks very much!! Note that the daily data have been interpolated to the common grid. The original
grid is polar stereographic.
We have received the ETHZ 25km RT3 data now, as well as monthly means of their 50km simulation.
There are now new versions of the INM data files. Have a look!
There seems to be problems with the INM data files. It is being looked into.
Finally, the 50km archive has been completed with the upload of data from the Hadley Centre. Note the new link a bit further up the page to the table of experiments.
The 50km ICTP data are online.
The MPI data and the corrected SMHI data are available now.
Erik van Meijgaard has found inconsistencies in several data sets. The SMHI data are being replaced by ones where the time variable is the
same as for the other institutes. I am behind schedule in fixing flaws in other data sets; I apologize for this, and I
will try to catch up.
Some issues are:
- Precipitation from DMI has the wrong units (mm/day instead of mm/s (=kg/m^2/s)).
- North pole latitude and longitude is interchanged in a lot of files
- The CNRM output of monthly averaged files has as time-unit:
"months since 1950-1-1 00:00" which should be "months since 1950-01-01
Their time-units in the daily files is correct: days since 1950-01-01
The UCLM files do not contain a grid_mapping variable "Lambert_Conformal".
Instead these files contain a global attribute
grid_mapping="lambert_conformal_conical" without parameter values.
In the namegiving of the files Erik found the following ambiguties so far.
i) Some names have a hyphen '-' between institute name (e.g.
CLMN-RM4.5), some don't (e.g. SMHIRCA)
ii) We agreed that the emission scenario under ERA40 should be indicated
as CTL, some however use CTR (SMHI,UCLM, maybe more)
iii) In the files with monthly averages some files have the period
included (e.g. CNRM-RM4.5_CTL_ERA40_MM_50km_1958-2001_rsds.nc), most
however don't . The latter format was agreed upon.
iv) The "CRU"-label should be attached to the resolution with a hyphen,
25km-CRU or 50km-CRU. GKSS uses an underscore. Moreover GKSS puts the
resolution in front of the time indicator, but it should be at the back.
v) In the monthly files of the GKSS-CLM model the filenames contain an
additional label to indicate what type of fields are imported into the
monthly averaging (e.g. MM_DM, or MM_UCT0). None of the other models
From a lot of institutes the MM-files are missing, from even
more institutes the MM-CRU files are missing.
The MPI 25km data are being uploaded at the moment and should be there today.
We now have 25km data from SMHI and from CHMI, as well as 50km data from INM. More data are coming as well. I try to update the table as the data come in.
With my apologies for being late in uploading: here is the resume of the RT3 meeting
at the General Assembly in Lund, which Markku mailed me a month ago.
I am currently uploading 25km KNMI data. Hence I have moved not just the KNMI 50km data, but all data
to subdirectories with the names 25km and 50km as appropriate. The clickable table has been updated,
and all links below have also been fixed.
Burkhardt Rockel's famous and very useful converson program to RT3-standard netCDF is finally here
at the web site.
The MPI data are now complete. At the same time I have received data from the ETHZ, which is also online now.
One more development is that I have finally constructed a clickable table from which you can access the data through OpenDAP and/or direct
download. I have put in contact information, which you are welcome to correct. Experiment acronyms link to model metadata. I hope that you will check the page
For those interested in the PRUDENCE archive, I can tell that the DMI 12km daily data are now online. Recall that this is a standard PRUDENCE simulation with 4 times the resolution,
using the Baltic SST's from the RCAO simulation. This means that this pair, F12/S12, corresponds to the HC1/HS4 simulation pair in 50km resolution. Note that each field is split into
3 decadal files with indices corresponding to the decade. Direct download from
http://prudence.dmi.dk/data/daily/DMI/F12 and DODS download from
http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/prudence/daily/DMI/F12 and correspondingly for S12.
Finally the netCDF software at this server has been upgraded to version 3.6. This means that the data sets can finally be accessed with DODS/Opendap. While you are
waiting for me to create a clickable table, you can use the URL
http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/ as entry point. Recall that you may have to wait for a while before the server responds, since it has to
unpack the compressed file before it is possible to read its header!
The 50km data from the MPI are being uploaded at the moment in the expected place.
Happy new year to everyone! My Christmas gift was a USB disk with the CNRM 25km ERA40 simulation data. I have moved the 50km data to http://ensemblesrt3.dmi.dk/data/ERA40/CNRM/50km.
We have received data from SMHI and also here from DMI.
Note that the latter have been made with the model that will be replaced with a new version soon, such that this simulation will also be replaced.
Link to the A2 simulation from C4I is here. Unfortunately
our DODS can not read the files yet, since we use entCDF 3.5 and the C4I files are 3.6. This will be changed
Currently I am uploading a new version of the KNMI data with an error being corrected. See the global attribute "comments" for
explanation, and the attribute "realization" to see what version a file is. The new version will take the
default position http://ensemblesrt3.dmi.dk/data/ERA40/KNMI/50km,
whereas the old version has been moved to http://ensemblesrt3.dmi.dk/data/ERA40/KNMI_version1/50km.
We have also received monthly means for the CNRM simulation, and we have data from the GKSS now, of course in http://ensemblesrt3.dmi.dk/data/ERA40/GKSS/50km.
I shall make a clickable table like the prudence one shortly.
Finally, I have made files "md5sums" in each data directory. You can check the vconsistency of a downloaded file by running md5sum on it and comparing. Have fun!
We have received ERA40 data from UCLM. Direct access and DODS/OpenDAP access
is available. Furthermore, the Irish C4I data in 25km resolution for ERA40 and also for a transient A2 simulation (link will follow).
The KNMI data apparently has a parameter error in the soil scheme. It has not been decided if ti is so serious that the run will have to be redone. But be forewarned that the KNMI data may not be what you should use. We will let you know asap.
Now we also have KNMI data there, they can be accessed directly at http://ensemblesrt3.dmi.dk/data/ERA40/KNMI/50km or through DODS/OpenDAP as http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/ERA40/KNMI/50km. The data are
restricted to project participants for the moment being; they will be public at the latest when ENSEMBLES reaches its end.
The Hadley Centre has produced some plots describing their experiments. Get the contents of http://ensemblesrt3.dmi.dk/HC
The people who have delivered test data have all put ISCCP cloud data in different files for different levels. So, let's do it that way. Remember the nomenclature clisccpH, clisccpM, and clisccpL.
We have the first data set available now! The CNRM RT3 run (ERA40) can be accessed directly at http://ensemblesrt3.dmi.dk/data/ERA40/CNRM/50km or through DODS/OpenDAP as http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/ERA40/CNRM/50km. The data are restricted to project participants for the moment being; they will be public at the latest when ENSEMBLES reaches its end.
Please report errors or deviations from how YOU thought it was going to be; I am not necessarily correct.
NOTE that the data is stored in gzip'ed format. This is to your advantage when you download entire datasets. However, when using DODS you have to be patient, since the entire file will have to be unzipped before you can see the DODS entry page!
Lots of small questions keep popping up. Some examples:
- What is the "scenario" part of the file name for ERA40? CNRM started out with "CTL", i.e. file names like CNRM-RM4.5_CTL_ERA40_12H_50km_196209_va700.nc. You could do the same.
- What about soil levels and ISCCP cloud levels in file names? It has been suggested to use numbers starting at the top for soil levels, e.g., ..._tso2.nc and capital letters "L", "M", and "H" for the 3 ISCCP layers, e.g., _clisccpL.nc.
- File names of monthly means of sub-daily fields, I think should just have _MM_ in their names. How we shall describe them in the netCDF attributes, I will post when I have found out.
- Should momentum flux include gravity wave drag? The consensus (?) I think is to just use the turbulent flux from the boundary layer scheme.
- Which fields should be interpolated with land-sea discrimination? I suggest that all diagnostic surface fields, including 2-meter temperature and 10-meter wind should be discriminated. Surface pressure, upper-air fields etc. should not.
I have generated a land area fraction file and an orography file that you can use for the interpolation of monthly RCM output. Unless you have any protests I suggest that we use a lapse rate of 6.5 degrees/km for any temperature for the interpolations.
Hopefully final minutes from the RT3 meeting in Copenhagen 13-14/3/2006 are now available.
Some inaccuracies have been pointed out by Anders Ullerstig: The CRU-grid is 278x170 points. I mistyped the file name convention, as I forgot the time period. Please start on January 1st in years ending with "1", and please use the numbering of days indicated in the list, i.e., days after 1-1-1950. Monthly means should be collected into one file for the whole simulation period.
30/3/06, updated 3/4/2006 and again 7/4/2006:
We now have an updated and hopefully final RCM output list after a lot of work by Burkhardt and Silke and also myself. As mentioned in my mail, some further requirements are:
Daily data should be stored in its original lattice in files with a decade in
each, with a naming convention like: "<institute/model
acronym>_<scenario>_<short driving model/simulation number acronym>_<time
sampling>_<resolution and interpolation>_<period>_<field name and level>", e.g.
Where the convention about sampling is: MM:monthly mean, DM:daily mean,
DC:diurnal cycle, 6H:6 hourly, 12h:12hourly
Furthermore, you should also deliver monthly means on the original grid, i.e.
with names like DMIHIRHAM_A1B_ECH51_MM_25km_t850.nc . These data should also
be delivered interpolated to a regular CRU-like 0.25-degree grid with the
definition [-23.875,45.375,29.125,71.375,0,-90] and 278x170 points (sorry for the previous typo). Exact
specification of driving model in global "comments" attribute
_FillValue=missing_value=1e30f for the interpolated fields. Names for these
fields should be in the style DMIHIRHAM_A1B_ECH51_MM_25km-CRU_t850.nc (note
I will make land-sea-mask and orography files for the regular area shortly.
These conventions are heavily inspired by the conventions already in place for the GCM people.
Coordinates rlon, rlat, lon, lat should be defined as in PRUDENCE (see the list).
I have made slight changes in the output list (the old one looked like this)
due to synchronization with the GCM database, which itself wants to synchronize with the IPCC archive. The changes are:
- Precipitation and evaporation are now average fluxes, measured as kg m-2 s-1.
- Integrated liquid cloud water has now been replaced by liquid+frozen water; and these integrated
amounts are now measured in kg m-2, as is integrated specific humidity.
- Field capacity is now an amount of water, kg m-2, and not a volume fraction.
- Global radiation has been removed, as nobody knows how it is different from downward SW radiation.
- Standard_name has been changed where relevant (I hope).
Comments are of course very welcome and may be discussed at the upcoming meeting.
Note the CF convention consistency checker at http://titania.badc.rl.ac.uk/cgi-bin/cf-checker.pl! -I have not tried it myself, but Burkhardt knows about it and
has recommended it.
We now also have documents with transportation instructions and hotel information.
Participants can find the agenda of the upcoming RT3 meeting in Copenhagen here.
A revised output list with netCDF standard_name attributes according to the CF convention can be found here in Excel format; sorry about the delay by me in posting it. Happy outputting!
The minutes of the RT3 meeting in Athens are available here.
Note also that there will be an RT3 meeting on March 13-14 at the Danish Meteorological Institute.
The area definition and output list is hopefully close to a final state now. You can find
18/5/05: Some links relevant to the specification of non-climatic environmental changes are
available on the internal pages.
17/5/05: There is now a document describing
the output and domain restrictions to which the RT3 RCM simulations should
adhere. Read it carefully!
22/3/05: Planned regional climate model simulations from RT3 and RT2B will provide
results for other RTx, such as RT2B, RT5, and RT6. Due to archiving
considerations, the amount of output needs to be planned so that it does not
become excessive, but nevertheless satisfies the foreseen needs. RT3 and RT2B
aim to provide such common output from the simulations. Some groups will store
additional data and on even higher resolution in time.
RT3 invites all RTs to check and comment on the list of proposed output.
Column "RT3" contains the suggested common output. Please notify by April 30
Ole BÝssing Christensen at DMI with comments and additional wishes.
10/2/05: The first RT3 meeting was held at the DMI in Copenhagen 7-8 February. The minutes should be up in a little while.
25/2/05: The minutes and a few talks from the Copenhagen meeting are now available from the newly inaugurated Member's-only page. Please login as you do at the main site.