All News Items
7/3/2011 There are now new ensemble-mean files for tas, pr, and evspsbl. The two former have very small differences to the previous versions, whereas the latter should now be OK. 4/3/2011 It is apparently only the CRU-interpolated HC monthly files that are upside down. I have now successfully calculated and uploaded the corrected monthly-mean DMI_BCM files! 3/3/2011 Dear all, please be careful with evaporation. I have looked at the evspsbl files recently, and I found that there are different sign conventions in use: Apparently MPI, ETHZ and CNRM have it positive downwards, i.e., mostly negative numbers. ICTP, KNMI, DMI, SMHI and HC use the opposite convention, with mostly positive numbers. I have not looked at the remaining institutes. Note also a potential issue, depending on your software: NetCDF CRU-interpolated files from the HC start with high latitude and go south, in contrast to everybody else. The "lat" array is correct, and the files are consistent. But, if you blindly read data from several models, you may get errors! These issues should of course be corrected. But, I am afraid that we do not have many human resources available, so I can guarantee that it will take some time. Good luck! 25/2/2011 Regarding the redone DMI_BCM simulation, I am afraid that the monthly files had problems -They are identical to the old ones. The daily files should be OK, though. Next week we should be there... 24/2/2011 The last 15 years of the DMI_BCM simulation have now been repaired, and all files should be updated by the end of today. The ensemble mean files will be done shortly. 21/2/2011 The units of evaporation, evspsbl, are wrong in the DMI BCM simulations. Possibly the same applies to runoff etc. We are checking this out and will replace the files asap. The missing period 2085-2099 has been rerun, and we are postprocessing at the moment. This also means that the ensemble-mean evspsbl file is very wrong; it will be replaced shortly. Apologies to everybody affected! 11/2/2011 The erroneous ensemble-mean evaporation has been replaced. Sorry! 4/2/2011 In the left menu I have added links to what came before us, the upcoming data archive of the CORDEX project. Once it grows, there will be an unprecedented amount of data with many combinations of GCMs and RCMs, several RCP scenarios and a patchwork of areas covering all land masses of the Earth. 3/2/2011 I have now finally removed the origional CNRM A1B and KNMI ERA40 simulations, which have been replaced by newer versions years ago. In case you need these data they still exist on tape. 25/1/2011 You can now download an evaporation ensemble mean calculated just like precip and tas as described under 24/6/2010. Note that the BCM model is still part of this in spite of the error mentioned 15/12. I have made the quick-look analyses public for your information. I have also uploaded a document describing the climate change signal of the ENSEMBLES RT3 simulations which reach 2099. Note that the error-ridden HIRHAM5-BCM simulation is part of the note. 15/12/2010 A serious error has been found in the DMI-HIRHAM5_BCM run: The period 208512-209912 cannot be used, since the insolation has been shifted by one month; boundary conditions have not, so there is no alternative to a rerun. Our apologies! 18/8/2010 There seems to be an error in the 50km-file SMHIRCA_A1B_ECHAM5_DM_50km_2091-2100_pr.nc.gz (gzip corrupted). It may take a while to regenerate it at the SMHI. 29/7/2010 11:40 The DMI_BCM files for 1971-1980 lacked lon and lat. They have been fixed now. 24/6/2010 11:40 A bit of smallish increments before the vacation: Some missing files from the SMHI HadCM3Q3 data sets are being uploaded right now. The new DMI BCM data now have interpolated monthly data. For my own, and possibly your, convenience I have constructed two files with interpolated monthly temperature and precipitation for the period 196101-209911. They contain pointwise monthly data for the ensemble mean of ICTP-REGCM3_ECHAM5, MPI-M-REMO_ECHAM5, DMI-HIRHAM5_ARPEGE, KNMI-RACMO2_ECHAM5, SMHIRCA_BCM, DMI-HIRHAM5_ECHAM5, METO-HC_HadRM3Q0_HadCM3Q0, SMHIRCA_ECHAM5, ETHZ-CLM_HadCM3Q0, CNRM-RM5.1_ARPEGE, DMI-HIRHAM5_BCM in the area covered by all simulations. These are the simulations going to the end of the century. I have excluded the simulations driven by HadCM3Q3 and HadCM3Q16, which are not very realistic. The data for 209912 are bogus; this is a copy of 206912, since not all simulations included 209912 and I wanted an array with only full years for practical purposes. Let me know if you find problems. Be aware that the ECHAM5 GCM has driven the majority of these simulations, so the averaging is not "fair". Also, remember that each of the 4 GCMs have followed their own trajectory from year to year. These fields only make any kind of sense if you look at longer-time averages. Finally, not all md5sums files have been up to date. I am currently running a script that ought to take care of this, so from now on it really should be possible to check whether your download was successful. If you forgot: Each and every data directory contains a small text file called "md5sums" with "fingerprints" of the data files. At a linux system you can run "md5sum -c md5sums" to check all files, or you can run "md5sum downloaded_file" and compare the resulting string with the content of my md5sums-file. This can be done under Windows as well, though I have no experience. Google came up with http://www.softpedia.com/get/System/File-Management/MD5-Checker.shtml. 17/6/2010 11:40 The HIRHAM5 simulation by DMI driven by the NERSC BCM model is now available. 8/6/2010 11:40 The SMHI_HadCM3Q3 data are now complete. 4/6/2010 11:40 The SMHI_HadCM3Q3 simulation is being replaced at the moment. The new simulation has its own greenhouse forcing following the scenario, in contrast to the former, where climate change only entered through the boundary conditions. 2/6/2010 11:40 Once more I have had to restart the web server due to greedy users flooding the machine with requests. Sorry to the rest of you! 21/4/2010 11:40 Two CHMI ERA40 25km hfso files have been replaced. UCLM A1B tdps files were wrong and have been replaced. I have taken the opportunity to collect decadal MM files into files for 1951-2050. 15/4/2010 11:40 I have had to restart the web server program, since a user at ethz.ch was using 46 of the 50 connections, hampering the net traffic of my entire institute. As I have stated below, we do not allow more than 4 simultaneous connections from one IP address. As we have not yet implemented a proper traffic control, I shall simply restart the server whenever I discover behaviour like this. I apologise to the rest of you! 13/4/2010 Some further SMHI files have been added/updated: BCM-driven clt-fields and HadCM3Q3-driven ua700 and va700 as well as the file SMHIRCA_A1B_HadCM3Q3_6H_25km_2091-2100_hur1000.nc.gz. 6/4/2010 In case you are not aware of what the Climate Explorer is: You can access not just ENSEMBLES and other model data, but more importantly lots and lots of historical station data. And the user interface is several levels above what you find here. 31/03/2010 More selected CRU-lattice fields from the METNO simulations are on their way. At the moment for the A1B BCM-driven simulation. More thanks to GJvO! 30/03/2010 Some good news for once: We have received a 3rd party contribution from Geert Jan van Oldenborgh of KNMI Climate Explorer fame: CRU-interpolated MM files for the important fields psl, tas and pr for the two METNO A1B simulations where we have been waiting for interpolated files for a while. Thank you!! 26/03/2010 15:00 Dear Squall1, that is not what I meant! Anyway, you are not beating the record. You are only using 42 connections. Still, the idea of a penalty box seems better and better. 26/03/2010 14:00 Two persons downloading RCM data are now using the entire bandwidth of DMI, 150.217.82.100 and 193.144.147.75; this means that the server ensemblesrt3.dmi.dk is causing delays for all my colleagues working at the institute. One of the two heavy users is even an IP address which was blocked yesterday, and was allowed access again after promising to behave. With a shattered belief in the universal good, I will now look into setting up a blacklist with a quarantine period, whenever I see a user doing massively parallel downloads, something like more than 4 retrievals from the same IP. So: The easy way is to NOT use "download accelerators" at all. Btw., squall1 is nothing. Our good friend 150.217.82.100 managed 46 simultaneous downloads out of a grand total of 50... 26/03/2010 12:00 DAMN IT! New record: Somebody at squall1.zmaw.de now has 28 simultaneous downloads running. This is like the gold rush. Try to be a little less trigger-happy to avoid server casualties! I assure you, there is plenty of bytes for everyone. 26/03/2010 11:00 One of the "sinners" has informed me that a firefox plugin called DownThemAll silently starts multiple downloads. This probably applies to a lot of other applications. Right now, with this extraordinary load on our server, I would like to ask you to check your own download method and be modest. Otherwise a quiet morning here, it is sunny, and only 3 users are downloading; may be the spike yesterday was mainly due to the fact that we have had a very long downtime. With a bit of luck, you might be able to do a couple of simultaneous downloads in the future. However, please restrain yourselves. Be polite. For your information: Our server, which is also prudence.dmi.dk, is a dual processor linux machine running apache, with 22TB of RAID disks, which are almost full. Our connection to the outside world goes through the line of our host, the Danish Meteorological Institute. This line has a capacity of 100Mbits, or around 1TB/day. The last year, the total ATTEMPTED download from ensemblesrt3.dmi.dk has been a bit less than 100TB. In the same period the prudence archive has had a download of only 6.5TB, however 3.5TB of these in this month. You might want to print these data, but keep in mind that the stack of paper would be around 5000 km in height, and would take at least 2000 years to print... We do not know how large a fraction of these numbers are successful transfers; most of the time probably all of it, recently probably a small fraction. Our record month was September 2009, where a user actually downloaded 22TB, i.e., the entire archive. This month until now has been quite busy in spite of all the downtime with 10TB, of which half has gone to one user. The current attempted use is close to the practical limit of the system setup that we chose. This means that it would be greatly appreciated if you limited your downloads to what you need. Getting the entire archive and then throwing away what you do not need is a disservice to your co-users. Remember OpenDaP; it may require a bit of work to start using, but it saves waiting time for everybody due to the decrease in bytes transferred! 25/03/2010 13:00 Join the club, fog.ethz.ch. (129.132.165.67) with 14 simultaneous downloads. I have also noticed that "Get ASCII" in OpenDaP does not always work. We are aware that the version on the server is quite old, and we will upgrade in due course. Meanwhile, apologies from myself and 95.95.185.203 who seems to have his/her quite own interpretation of what an ensemble is: All OpenDaP data are downloaded in 4 identical versions... If you have not yet understood my message: If you don't get an immediate reaction from the server, DO NOT click repeatedly, particularly in the OpenDaP interface. 25/03/2010 12:00 We are up, but there is a tremendous load. This is again because some impatient users have several simultaneous requests, even several IDENTICAL requests running. PLEASE only click the link once... I am talking to YOU, 95.95.185.203 at cpe.netcabo.pt, downloading 22 UCLM files at one time through OpenDaP, and to 195.13.157.131 (HERMES.fmf.lu.lv.) with 13 simultaneous HC data downloads... 25/03/2010 The trouble continues. We apparently still have to do some trouble shooting, even though the information below still very much applies. I do apologise for this; and I urge you all to start slowly when the server starts behaving as it should. -Otherwise it will be flooded again again. PLEASE do not click a data link 100 times! PLEASE start with one download. I just restarted the apache server, and I had a glorious 9 seconds of accessibility before the server was once more flooded. I know you have all been waiting for data, but we only have a limited capacity; and this capacity can not be increased from one day to the next... 24/03/2010 DEAR USERS, PLEASE READ THE FOLLOWING! As you are probably aware, this archive has been having huge performance problems for a while. We now believe that we have found one reason, and this reason is one particular user. I will give some details below, not to place blame, but to inform you all how NOT to do. Somebody, a Mac user probably from Italy, has been using a download manager called iGetter to access data files at prudence.dmi.dk, which is actually the same machine as ensemblesrt3.dmi.dk. This is of course OK. The problem is that this piece of software starts a number of parallel downloads. The setup of this user started a number so large that we hit the ceiling of the apache server here, basically excluding the rest of the world. It is probably not this particular user and program who is responsible for all the downtime, but he/she certainly has been a major part of the cause this week. Please, all users, be aware that parallel downloads may give you better access time now; but you are in fact taking the bandwidth from other users. Next time you will be the one unable to get through. So, be nice! 23/03/2010 I have uploaded new MM files for the old CNRM_ARPEGE experiment. I apologise for the intermittent hangs that a lot of you are experiencing. We have a software problem, which we have not yet identified. If you experience a hang, you are welcome to mail me about it -Then I will restart the server software. 18/03/2010 CRU-interpolated data have been added for the SMHI ERA40-run in 25km resolution. An entirely new data set for the HadCM3Q3-driven SMHI simulation is being uploaded. An error was discovered in the earlier data set, related to the CO2-concentration during the run. 08/03/2010 Errors have been found in the two files CHMIALADIN_CY28_ERA40_DM_25km_1961-1970_hfso.nc.gz and CHMIALADIN_CY28_ERA40_DM_25km_1971-1980_hfso.nc.gz I have taken down the page "outstanding data problems" as it has been hopelessly out of date for a long time. It will be revised and put back up again. 24/02/2010 Two corrupted KNMI files have been replaced: KNMI-RACMO2_A1B_ECHAM5-r3_24H_25km_2001-2010_zg850.nc.gz and KNMI-RACMO2_A1B_ECHAM5-r3_6H_25km_1971-1980_zg1000.nc.gz Corrected SMHI ERA40 files are on their way. CNRM files are currently being repaired wrt. the format of monthly time variable (see below, 14/1/2010) 22/02/2010 There was an error in the matrix table regarding the C4I simulation driven by ECHAM5 according to the SRES A2 scenario: It follows ECHAM5 ensembles member 1 and not member 3, which is the standard one used for the A1B simulations; the control period of the ECHAM5 simulations use historical emissions and are therefore the same for different future scenarios, but are different for different ensemble members. This means that the control period 1961-2000 of the C4I simulation is NOT identical to the control periods of the A1B simulations. 8/02/2010 The corrupted file SMHIRCA_A1B_BCM_DM_25km_2051-2060_prls.nc.gz has been replaced. I have uploaded even more GKSS_IPSL files now. 3/02/2010 From the GKSS I am uploading mrros mrsos and mrross files. From the CNRM I am uploading CRU-interpolated MM files. More will be coming shortly. 14/01/2010 Take care with CDO. I have been told that there is a serious problem when using the MPI tool CDO to handle monthly mean (MM) files, and have just realised how serious it is. Frequently, the files in this archive have their time unit as "months since 1950-01" with type "float" or "double"; and frequently e.g. the first month of 1950 would have the value 0.5 to indicate that it is centered in the middle of the month. However, CDO assumes that months would be of type integer and "solves" this problem by rounding. This means that a value of 0.5 would be rounded to 1, and it being interpreted as February 1950. This is only a problem (as far as I know) for the CDO tool and for files with floating point time coordinates with half-integer values. I am currently about to correct this for CNRM, but there are lots of these files around, so it will take a long time to convert the time coordinate of monthly files to integer type. 13/01/2010 The existing GKSS A1B files have been corrected now. Two files had errors: GKSS-CCLM4.8_IPSL_24H_IPSL-50km_1991-2000_mrso.nc.gz and GKSS-CCLM4.8_IPSL_24H_IPSL-50km_2001-2010_zg200.nc.gz. They will be replaced when the second batch of files arrives. Do you know by heart what a Rockel-box is? If not, look here. These European sub-areas have been used both in PRUDENCE and in ENSEMBLES for model intercomparison. 12/01/2010 I forgot the link to the CHMI AMMA-region A1B simulation. It is fixed now. I am still uploading files to this directory! You better wait a day. 06/01/2010 Happy new year to everyone! In collaboration with Burkhardt Rockel I have been correcting GKSS A1B European data, which had several problems in attributes and time coordinates as well as in the file name syntax. Unfortunately further errors were discovered in the middle of the processing. Therefore, this directory currently contains two kinds of files: Some with old file names and all errors, some (placed in directory "temp") with new file names and most errors corrected. All fields are correct! We are only changing attributes. In the near future, hopefully within this month, I will correct the files. I hope you can live with the inconsistencies in the mean time. From the MPI we have retreived: Corrected files with hur1000 hur700 hur850 hur925 ps zg1000 zg500 for the 2071-2080 period hus300 for the 1981-1990 period (AMMA/RT3), monthly-mean data on the CRU-grid for AMMA A1B, and daily data for the year 1950 for AMMA A1B. 15/12/2009 METNO A1B MM data have arrived. 9/12/2009 CHMI AMMA-region A1B data are almost there now. There is some variation in the starting dates of these AMMA-region transient simulations. To help a bit I have added starting dates to the matrix. 9/12/2009 The data mentioned below are complete now on the server. 7/12/2009 The MPI have sent a disk with climate-change data for the African region. These data are being uploaded now and ought to be there tomorrow. The INM have also provided CRU-interpolated files now, both for the European ERA40-runs and for the AMMA runs. They should be up soon. 1/12/2009 The first gift in the advent calendar contains AMMA-region A1B data from the INM, driven by HadCM3Q0. The data are still being uploaded, so take care! 30/11/2009 Now we have European A1B output from GKSS: CLM driven by the IPSL model. Also the MPI have delivered: REMO over the AMMA region driven by ERA-INTERIM. NOTE that we now also have an AMMA-region matrix online (move your eyes a bit to the left). 20/11/2009 Dear colleagues, good to see you again in Exeter! You now have access to a new CNRM ARPEGE-driven European simulation. In contrast to the old one (still there) it goes to 2100, and it uses a different ARPEGE ensemble member. Also GKSS data are now accessible. This is the AMMA-experiments, both ERA-INTERIM and ECHAM5-driven climate change. 12/11/2009 There are new and correct maximum and minimum fields from the ICTP (see below, 7/10). I am uploading AMMA data from the GKSS, both ERA-INTERIM and ECHAM5-driven. Also a new CNRM European A1B simulation is being uploaded. This simulation goes to 2100 and uses an updated model version. I plan to keep the old version and rename it when the upload is complete. 5/11/2009 We shall have to reboot the server at 13:00 CET. Sorry for your inconvenience! 28/10/2009 We have received AMMA-region ERA-INTERIM data from the Hadley Centre. Please use the portal link to the left for access. 16/10/2009 A small (?) error has been found in all DMI data sets: For the fields prc, prls, pr, prsn, tauu, tauv, hfss, hfso, hfls, rss, rsds, rls, rlds, rst, rsdt, rlut, mrros, mross, mrro, mrso, as, prw, clwvi, clivi, wss, mrso, mrsos, tso, mrsos (basically all fluxes plus 10-m wind, albedo, soil fields) there is a normalisation error in every first value in each month. -One extra 10-min time step was included without proper normalisation, so you can get very close to correct values by multiplying the value by period_length/(period_length + 10min). This also applies to monthly averages. Sorry! 7/10/2009 The ICTP has found a postprocessing error in all daily max and min fields for the A1B European and the two AMMA runs, i.e., not for the ERA-driven European runs. The fields have been deleted now, and new corrected fields are expected in a week or so. Sorry for your inconvenience. 6/10/2009 Sunshine duration (sund) in all the DMI-HIRHAM output was given in the incorrect units (hours as opposed to seconds). This has now been corrected. 30/9/2009 As you may have noticed, we have been down since Saturday. The reason was a power failure at the DMI. We only discovered its consequences for the web service yesterday, and we were quite lucky that no hardware seems to have been damaged. To my knowledge everything is up and running again, so PLEASE let me know if you experience difficulties. 22/9/2009 The error was worse than I thought. I am afraid that the DMI hursmax and hursmin cannot be used and cannot be recreated... Thanks for the help, Pascal. 22/9/2009 An error has been found in all DMI files with maximum and minimum relative humidity (hursmax, hursmin). They are off by a factor 600 (the time step in seconds :-( ). So, please divide the values by this number, or wait a few days until we have fixed the files. Sorry about this. 16/9/2009 Two new data sets: ICTP AMMA-region ERA-INTERIM and UCLM AMMA-region driven by HadCM3Q0. Enjoy! 26/8/2009 The SMHI have discovered some errors in their European simulations and are redoing them currently: Due to an error in the treatment of SSTs/sea-ice from ERA40 in the Rossby Centre RCA3-simulations at both 50 and 25 km sea-ice coverage is overestimated (always 100%) whenever the SST in a grid box is below -1.8C. Consequences of this error are too low air temperatures in some oceanic areas during some years. An error in SSTs close to the 0 degree meridian for a few decades has been detected in the Rossby Centre RCA3-simulation with HadCM3Q3 on the boundaries. As a consequence the annual cycle of temperature is too small during the period January 1982 until November 2029. 25/8/2009 Fixed the missing link to the European METNO downscaling of HadCM3Q0. Sorry! 17/8/2009 We have received new tdps files for the SMHI A1B European simulations. We are uploading A1B AMMA-region data for HadRM3P driven by HadCM3Q0. 12/8/2009 So, now we have corrected UCLM files plus AMMA, we have METNO AMMA runs for both HadCM3Q0 and ERA-INTERIM as well as a voluntary HadCM3Q0 RT2b run. 10/8/2009 Back from vacation I found disks from UCLM and METNO. Expect new data soon... I have been informed that the OURANOS prhmax fields have the wrong units: 50km data ought to be divided by a factor of 4, and 25km data by a factor of 6! 10/7/2009 ICTP AMMA A1B data are being uploaded at the moment. Should be complete by the end of the day. The SMHI AMMA A1B files were erroneously labeled "HadCM3Q1" The correct driving model is HadCM3Q0. The names (and only the names) have been replaced. 1/7/2009 The UCLM have found a serious error in their AMMA data; please be aware of that! These data are removed now, and new data should be available at the earliest in mid July. 30/6/2009 Results from the DMI AMMA region experiments are online. ERA-Interim data are complete, but A1B is missing the decade 2031-2040. This is currently being reprocessed and should be up by the end of the week. 24/6/2009 The DMI-ECHAM5 results (including CRU-interpolated) are now all on the server. 16/6/2009 There are updated CRU-interpolated files from C4I for all their experiments. 2/6/2009 The DMI results driven by ECHAM5 are finally available (currently being gzipped in-place). For the moment being only up till 2050; the rest should be ready within a week. 27/5/2009 AMMA-region ERA-INTERIM data from INM are now online. 25/5/2009 The VMGO scenario run was put in the wrong place in the matrix. It has been driven by the normal-sensitivity HC experiment HadCM3Q0. Sorry! 15/5/2009 The ENSEMBLES and PRUDENCE RCM databases are now accessible via the KNMI Climate Explorer! Many, many thanks to Geert Jan van Oldenborgh! The data are accessible as "External data". Obviously, the ENSEMBLES and PRUDENCE data policies are still in force if you access the data this way. For now it is only the monthly-mean data that are available. But via this connection you are able to do all sorts of data manipulations and analyses, which have not been implemented on this web site. Good luck! 13/5/2009 We now have ERA-INTERIM runs over the AMMA region from SMHI. 29/4/2009 Dear friends, today the first AMMA-region data have come online. The West African data, both driven by ERA-Interim and by ECHAM5-r3 are available for the KNMI RACMO model. Furthermore, KNMI has made four (4) further 50km A1B simulations over Europe available to us. They are driven by ECHAM5-r1, r2 and r3 and by the MIROC model; note that ECHAM5-r3 is the reference ensemble member. Whether we will have space to keep the latter data when the rest of the AMMA-runs come in, is not clear to me at the moment. 24/4/2009 We now have the VMGO A1B data ready. Thanks! 17/4/2009 All METNO MM-files of accumulated variables (evspsbl, mrro, prc, prls, pr, prsn, sund) had a wrong scaling. They have now been replaced. 1/4/2009 The ICTP A1B data are now available. Some time tonight, you will also be able to find all the SMHI HadCM3Q3-driven data. 30/3/2009 The HadRM3Q3 and 16 output data are now all available. The SMHI ECHAM5-driven run lacked a few interpolated MM files. They are there now. The ICTP transient data are being uploaded at the moment. SMHI data driven by HadCM3Q3 will be there in a few days. The ARPEGE driving-model data residing in the CECILIA directory (see 16/2/2009) now has FIX fields. 27/3/2009 There were errors in the CRU-interpolated DMI snw files, in that the oor-values were wrong. They are being corrected now. The backlog of data is being uploaded. We now have SHMI data driven by the ECHAM5 global run. Also, the Environment Canada data have been replaced. The HadRMQ3 and Q16 data are in the process of being uploaded, but this will not be complete until next week. I have today received a disk from ICTP, and I am in the process of preparing data from the Voeikov Main Geophysical Observatory of St. Petersburg. Hopefully they will be up soon; the VMGO data will probably not be entirely complete for around a month, though. 23/3/2009 DMI snow amount (snw) and snowfall (prsn) have been corrected, so they should both now be in the correct units. 20/3/2009 Rejoice! The new disks have been installed now. Currently, the SMHI ECHAM5 data and the HadRM3Q3 and Q16 data are on their way up. Also Environment Canada ERA40 data are being replaced: The daily and sub-daily fields used to be interpolated to CRU; now they are being replaced by native-grid data. 18/3/2009 We are working on the setup of the new disk array. Hence the server will be rebooted intermittently, probably over the next couple of days. Sorry for the inconvenience! -But look forward to the Russian VMGO simulation, revised Environment Canada ERA-data, the SMHI ECHAM-driven simulation and the HC HadRM3Q3 and HadRM3Q16 data as well as some revised HadRMQ0 files... 9/3/2009 The revised AMMA-domain files with orography and land-sea fraction are ready now. 5/3/2009 I have changed file- and field-names for the HC monthly-mean files called tsmax. They were actually ts! Daily files are what they claim. The new disks have arrived. We still need to install them and put a file system up, but it should not be long now! I have updated the participant list slightly. Any comments from participants are appreciated. The combination matrix of which regional models will downscale which global simulations can now be accessed from the left menu. Numbers in parentheses indicate the expected delivery date for data not yet in the archive. Thanks, Philip! 4/3/2009 For project participants, the talks of the Toulouse meeting are now available here. 1/3/2009 For consistency, I have renamed all the C4I A1B files, since the driving GCM is the HadCM3Q16 high-sensitivity simulation. 27/2/2009 From Tido Semmler at C4I we have received a bundle of validation plots versus HOAPS satellite data. Project participants can follow the link in the left menu. The DMI runoff files are being repaired at the moment. From tomorrow all DMI mrro and mrros files should be OK. I forgot to tell you that all HC monthly mean files called tsmax actually contain average surface temp, i.e., they should have been ts instead of tsmax. I believe that daily files are OK. 26/2/2009 I have received data from Environment Canada and from St. Petersburg Geophysical Observatory as well as additional fields from the Hadley Centre. Unfortunately the new disks have not arrived yet, so I am not able to upload the data. Sorry about that! I did a bit of conformance checking. As a result the files from METNO have been renamed: Underscores between field name and level have been removed, replacement of "_" with "-" in year ranges (e.g. 1961_1970 -> 1961-1970 ). 25/2/2009 The errors mentioned 20/2 have been corrected now. However, another further different error has been discovered in the DMI data sets: What we thought was surface runoff in the model was actually total runoff. This means that the current mrro files actually contain 1xsurface runoff + 2xdrainage. The mrros files contain the total runoff; the mross files, correctly, contain deep drainage. I will replace the files shortly. 20/2/2009 A multitude of small errors are in the process of being corrected for all DMI data. The time and time_bnds variables are being corrected and turned into type double. Most files had an error in the rotated_pole attribute, where the latitude and longitude were interchanged. Errors have been found in some of the BCM-driven SMHI data. One batch of corrected files has been uploaded, more corrections are on their way. 16/2/2009 The good news: The ARPEGE data that have been driving some of the RCM climate change simulations are now accessible. Please look in http://ensemblesrt3.dmi.dk/data/CECILIA/CNRM The bad news: I have made a mistake in ALL DMI data files: For the native-grid files, the rotated longitudes and latitudes have been interchanged. And for the CRU-interpolated files I still have a rotated_pole attribute -even the erroneous one... I shall start correcting them in a little while... The projection is in reality obviously the normal: Rotated longitude at -162 degrees and latitude at 39.25 degrees. 10/2/2009 It has been reported that the new SMHI BCM-driven data is written in the compact netCDF form that includes an offset -and that the offset is not to be found in the file. So, take care while this is being checked out! 6/2/2009 The DMI monthly means seem to have an error in the time coordinate. The 480 months cover 196101-200012. Sorry! It has been reported that the METNO and DMI snow cover data (snw) may be in the wrong units (m of water, and not kg/m^2; should be multiplied by 1000). This is still to be investigated; take care! 2/2/2009 The ICTP have found a serious error in their A1B ECHAM5-driven simulation. Therefore the data have been removed. 30/1/2009 From SMHI we have received and uploaded a 25km simulation driven by the Bergen Climate model. Enjoy! KNMI have provided new metadata-descriptions. The new main reference for RACMO should be Meijgaard, E. van, L.H. van Ulft, W.J. van de Berg, F.C. Bosveld, B.J.J.M. van den Hurk, G. Lenderink, A.P. Siebesma, 2008: The KNMI regional atmospheric climate model RACMO, version 2.1. KNMI Technical Report 302, 43 pp. Available from KNMI, Postbus 201, 3730 AE, De Bilt, The Netherlands. http://www.knmi.nl/bibliotheek/knmipubTR/TR302.pdf Plots of the KNMI 25km surface fields can be found here. 22/1/2009 We have received and uploaded daily minimum and maximum temperatures for the ICTP ERA40-simulation now! -In contrast to the other HC-driven runs, the C4I time and time_bounds variables seem to be an unhappy mixture of Gregorian and 360-day numbers. 21/1/2009 The C4I HC-driven climate change runs apparently have the wrong calendar attribute. Please be aware that the HadCM3 and hence all RCMs driven by that use 360-day years. 16/1/2009 The RCM data archive has now been opened to the public! Enjoy! You will have to follow the ENSEMBLES data policy. We would like to keep track of the users by asking for an email address; this is not yet in the scripts, but you will be asked explicitly shortly. 15/1/2009 The DMI data are now complete, including CRU-interpolated fields. I apparently misunderstood something about the corrected METNO fields: It is all data that are affected, not just the period I mentioned below. All Feb. 29 field values were 0. 9/1/2009 I apparently made an error when trying to upload the repaired HadRM3Q16_CTL_ERA40_MM_25km_pr.nc.gz -It should be OK now. 8/1/2009 The ENSEMBLES consortium has now agreed upon a data policy. This basically means that the data will be open to all sorts of use, provided that you mail me any publications that build on these data. We will remove the password protection, as soon as we have figured out how to force you to have agreed upon the policy before downloading data -Today or tomorrow, I reckon. 5/1/2009 The DMI data are now complete on the server, both the A1B CNRM-driven run and the replaced ERA40 25km run. 3/1/2009 Happy new year to all of you! One of the New Year's promises we all made was to have our data ready on the server now. I am very happy to announce that the DMI has more or less made it: The A1B data are ready now, and the new 25km ERA40 data are being uploaded and should be complete in a couple of days. NOTE that all directional winds (ua's and va's) are wrong in these data sets -I shall remove the files shortly. Also the new UCLM files are complete now. Thanks! 18/12/2008 The DMI ERA40 25km data are being replaced now by a version with somewhat fewer bugs. There are new UCLM A1B data being uploaded. Unfortunately they are a bit delayed at the moment due to software trouble. 3/12/2008 I have finished uploading the METNO data. Some OURANOS files have been renamed to be consistent with the rest of the archive (e.g. tso_1 changed to tso1 ). The DMI A1B data are slowly being uploaded. DMI ERA40 data will be replaced by newer bug corrected data before Christmas. 24/11/2008 I have received new data from METNO for the decades 1951-1960, 2001-2010 and 2041-2050 for their A1B simulation. They are being uploaded at the moment. The OURANOS data ought to be complete now. 18/11/2008 The OURANOS data are up. Unfortunately some DM files 1991-1995 are still missing, due to a corrupted tar-file. 14/11/2008 Due to a script from the ETHZ, the ERA40 ETHZ MM-files now have a correct time array. The new OURANOS ERA40 dataset should be complete in a few hours. MPI A1B CRU-interpolated MM files were mistakenly put in a subdirectory. Now the are located where they belong. Sorry! 12/11/2008 I have put up repaired CRU-interpolated monthly tas files for all three C4I experiments. 11/11/2008 A clarification: Note that the CNRM boundaries used as the driving data of the ALADIN simulations (CNRM and CHMI if any) as well as of the DMI simulation are ARPEGEv4.5 (stretched grid as in PRUDENCE), which can be accessed through the CECILIA database also located on this machine and. It is NOT the CNRM-CM3 RT2A simulation of ENSEMBLSES. HadRM3Q0 data are now uploaded until 2100. On the other hand the HadRM3Q3 and HadRM3Q16 A1B simulations now only has tas, pr, and ps files available due to our filled disks. Sorry for the inconvenience! DMI ERA40 25km data will be replaced in the near future. ETHZ A1B files 2051-2100 will be there shortly. Remaining OURANOS ERA40 data are being uploaded. 6/11/2008 The EC data set now has FIX fields as well. The DMI A1B data for 1981-1990 have been replaced, as a couple of months were missing from the files. UCLM has delivered a number of corrected ERA40 fields, which are being uploaded at the moment. If you discover further fields with errors, please let me know. 5/11/2008 There has been some problems in the UCLM data, where buggy and fixed files were mixed. I will upload corrected files shortly. The HadRM3Q0 data have been extended to 2100 now. We have received MPI CRU-interpolated MM files. The file METO-HC_HadCM3Q16_CTL_ERA40_MM_25km_pr.nc.gz was broken and has been replaced. More DMI A1B data are being uploaded. We have a problem: Our disk system is filling up at the moment, and it will take some time to get a new set of disks. It will probably be at least a month until we have a solution. In the mean time I shall have to temporarily remove some data in order to make room for other sets. My plan is to put the high- and low-resolution HC runs, HadRM3Q3 and HadRM3Q16, offline except for the a few fields (tas, pr, ps). These runs are voluntary contributions, and they take up a lot of space. I have these data on an offline disk, so they will be put up again as soon as the extended disk system is available. 14/10/2008 From the HC we now have all 3 HadRM runs up to 2050. The holes mentioned below (3/10) are still there. We have also received data from the 3 driving HadCM3 runs now! 7/10/2008 We have received CHMI CRU-interpolated monthly files now. There are also a bit more DMI A1B files. 7/10/2008 I would like to bring a few obscure but important facts to your attention that have been a bit hidden on this web site: Not all models follow the Gregorian calendar! -Everything driven by HadCM3 will have 360 days in all years (30-day months). The OURANOS simulations ahve 365 days in all years. I believe that the rest of simulations use the Gregorian calendar, i.e. leap days every 4 years except for the year 2100. The common integration area which is used by all RCMs except UCLM and ICTP (who use a Lambert projection) as well as INM is described here. If I remember correctly, some RCMs use a superset of this area, but all points in the description should be there. This area is completely inside the buffer zone. Note that e.g. the westernmost edge defines the center of the westernmost grid points, not the outer edge. 6/10/2008 The CHMI ERA40 monthly means of tas have been replaced by corrected files. 3/10/2008 I found an OpenDAP configuration error, which may have caused the OpenDAP users problems, since it basically did not allow simultaneous users. The error would have been "Error building the DODS dataset query form" when trying to get the access form. There are more HC data on their way. I have been informed that there are some incomplete files on the server, which will be corrected shortly: "Some 6H data are incomplete, so far I (i.e., Erasmo) have found HadRM3Q3: 1951-1960 zg1000 HadRM3Q0: 1991-200 hur1000 HadRM3Q16: 1971-1980, zg500,zg1000,hur1000,hur925,hur800,hur700; 1981-1990, zg1000" 25/9/2008 The ETHZ ERA40 50km wss and wssmax fields have been updated due to a problem with one date. 19/9/2008 The UCLM have sent CRU-interpolated monthly files, and repaired files that included the buffer zone. 17/9/2008 The first decades of the DMI ARPEGE-driven A1B simulation are being uploaded at the moment. 11/9/2008 -And now the HC simulations are linked in the table. 9/9/2008 There are now 3 different HC A1B simulations with the different-sensitivity models. We have the period 1951-2000 currently and will get the rest later. The OURANOS A1B upload is complete. But the ERA40 simulations are being replaced due to a bug. Note that the new simulation is with a slightly upgraded model version, but we replace the data anyway, since the bug (which is not in the A1B simulation) made the first data set more different than the new one. This upload is under way, and the last part of will take some weeks to get here. 5/9/2008 The lat/lon problem has now been corrected for all HC files. 2/9/2008 A large part of the SMHI A1B files were corrupted. They have now been replaced. 1/9/2008 Good news and bad news: The OURANOS A1B data for the period 2016-2050 are being uploaded at the moment. However, this means that I have to move the directory between partitions. So very few of the OURANOS A1B data are available at the moment. It should be complete in a couple of days. 27/8/2008 INM have found errors in their precipitation files. I have replaced INMRCA3_CTL_ERA40_DM_25km_1961-1965_pr.nc.gz and INMRCA3_CTL_ERA40_MM_25km_pr.nc.gz (Tido: Also on your disk). 22/8/2008 Erroneous rotated pole coordinates in DMI and met.no file headers have been corrected. 21/8/2008 The Hadley Centre have sent interpolated monthly means. 19/8/2008 I have received ERA40 data from Environment Canada, which are now online. Enjoy! -Note that the results have been interpolated to the common grid. 8/7/2008 There are corrected MM files from the UCLM 25km ERA40-experiment. 3/7/2008 We have received extra 25km HC ERA40 runs with the high (HadRM3Q16) and low-sensitivity (HadRM3Q3) versions of their model system. NOTE that the existing HadRM3Q "normal" files have been renamed with the prefix METO-HC_HadRM3Q0. There are now interpolated MM files for the old HadRM3Q0 run. For the new runs there are currently ONLY interpolated files for monthly averages. Native-grid files will come later this summer. 25/6/2008 A new experiment has arrived: The ETHZ simulation driven by the Hadley Centre HadCM3Q0. 17/6/2008 The UCLM A1B data have not been accessible due to an erroneous link. Now they should be OK. I have also uploaded some corrected precipitation MM files for the UCLM ERA40 run (sorry for the delay). 08/5/2008 The METO-HC ERA40 files with interchanged lat and lon coordinates have been corrected for FIX and MM. 28/4/2008 The ICTP land-sea-mask files had errors in the coordinates and a wrong mask over the Black Sea. They have been corrected now. 25/4/2008 There were errors in the MPI interpolated MM-files. They have been replaced now. 22/4/2008 The UCLM, CHMI and MPI data are online now. I have (finally) updated the "Outstanding data" document -You may disagree with its contents, so have a look. It still remains to check the list of fields in the archive against file name inconsistencies. 21/4/2008 SMHI CRU-interpolated fields have been uploaded. UCLM A1B data are being uploaded at the moment, and new CHMI and MPI data are under way. I have introduced the "missing link" to the C4I HadCM3-driven A1B simulation. 10/4/2008 For participants, the Trieste meeting minutes are here now. 27/3/2008 Several SMHI files have been updated with "standard" time coordinates. 25/3/2008 I have received several complaints about the fact that a lot of files (from C4I, CHMI, MPI and SMHI) could only be read with netcdf versions at least 3.6. I have now converted SMHI ERA40 data using ncdump and ncgen. Hence, these files are supposed to be readable with netcdf3.5 now, but should otherwise be exactly the same. If you look at these files and see any changes, please let me know immediately; currently I have taken a backup of the old versions, but this takes up a lot of space and will not be forever. I will let you know how this task goes on -it takes a lot of computer time, but very little human time.\ METNO monthly means of water fluxes have an error: The normalization with number of days per month has not been done, so please divide by the relevant number of days. Corrected files will come! The missing CHMI 50km FIX files are now uploaded. Revised SMHI files will be uploaded shortly. 14/3/2008 We now have several updated INM files with various corrections; CNRM MM files (currently being uploaded) with the common interpolation method (very small changes!), and I have started the very long and tedious process of converting netcdf3.6-only files to something that netcdf3.5 understands. I have started with SMHI (ERA40) files, and will continue with MPI, CHMI, and C4I. These are the institutes with this kind of files, as far as I can see. 28/2/2008 The MPI A1B data for 2071-2080 had size 0. This has been fixed now. LOOK LEFT! We now have Philip Lorenz' quick-look plots available. Thanks! Due to a slight naming mistake in the new files you may still have downloaded faulty UCLM data for 1981-1990. They are OK now. 20/2/2008 We have received a disk from METNO. The Norwegian ERA40 data now have monthly means (MM files). We are currently uploading their RT2B experiment driven by the Bergen Climate Model -The link will be there in a day or two. 19/2/2008 We now again have OURANOS A1B data, up to 2015. Also, their ERA40 rsdt data have been corrected. 14/2/2008 The MPI and C4I data are up now, as well as new UCLM data. New KNMI mrross and clwvi files will be up today as well as updated tasmin and tasmax fields from ETHZ. 22/1/2008 The restore operation was not perfect, it turns out. The entire OURANOS climate change experiment has disappeared and will have to be transferred again. Also, some MPI ERA40 data seem to be missing; these files are actually present, but some of them are in two versions. The latter should be sorted out quickly, but take care in the mean time. It would be prudent if the ensemble of institutions checked the integrity of their archived data 8-( 11/1/2008 The faulty file /media/data1/ensemblesrt3/data/ERA40/CHMI/25km/6H/CHMIALADIN_CY28_ERA40_6H_25km_1971-1980_zg500.nc.gz has been replaced. The MPI data are complete, and the C4I data are being uploaded. 3/1/2008 Happy New Year to everybody! Finally the archive should be back to the status it had before we changed disks. PLEASE let me know if you find anything amiss! Currently I am uploading the MPI/ECHAM5 RT2b data. C4I is waiting in line and should become available next week. 19/12/2007 The site is up again, but be aware that the restoration of data will last at least a week. Apologies for your inconvenience. 18/12/2007 Some time today we will take the data archive offline in order to install new disks. The restoration of the data from the DMI mass storage will take at least a week. This means that the links will be there, but you may not find the data you are looking for. I apologize for your inconvenience, but there is no way around installing larger disks with the amounts of data we are continually receiving. 29/11/2007 We have received an SMHI A1B transient simulation in 50km resolution based on ECHAM5. Thanks! 27/11/2007 We have now ordered an upgraded and larger disk array. We will replace the 16 500GB disks with 16 1TB disks, hence doubling the capacity of the RAID array from 6TB to 12TB. In other words, the entire database will need to be restored from mass storage afterwards. The installation will be done some time between Dec. 16 and Christmas, and the upload time will probably be around one week, during which you can not be certain that a particular file will be in the archive. So, plan ahead! 19/11/2007 As you see, the site has been slightly modified. The relevant status documents from Prag have been put up on the left. Partners, please comment! 1/11/2007 We have received supplementary sftls files from HC. There seems to be a common problem with HC files that longitude and latitude have been interchanged. This will be corrected in the future, but will take some time. 24/10/2007 We believe that we have now successfully upgraded everything after a day with various errors. Please report to me if you have problems FROM NOW ON. 23/10/2007 We successfully upgraded the kernel, so that we now have 2 CPUs. Unfortunately the RAID array is not recognized, which means that only 2TB data are accessible at the moment. We are working on this! 23/10/2007 We shall have to take the server down this morning due to a kernel upgrade. 22/10/2007 If you have not already seen this: The DMI 25km simulations has some serious errors in points with non-zero glacier fraction. I will leave the data as they are until we have a chance to rerun the simulation. 4/10/2007 again somewhat later: We had to take the machine down again, but still without positive results. It should be a couple of days before it will become necessary again. Sorry for broken downloads and other inconveniences! 4/10/2007 a little later: Sorry for the downtime. Our BIOS did not accept the new CPU, so we shall have to do it once more in the near future, I am afraid. In the mean time the system continues as it was. 4/10/2007: We will have to briefly take the system down, since we are installing an extra CPU. Hopefully the system will be more responsive after that. 25/9/2007: We now have quite a lot of data from the transient 1950-2100 (!) ECHAM5-driven KNMI experiment in the archive. 17/9/2007: I found errors in the DMI MM-files that are based on sub-daily data. They have been corrected and uploaded. Also monthly means of the DMI 50km run are available now. 12/9/2007: The monthly means of the DMI 25km runs are now complete. 5/9/2007: The ICTP, HC and UCLM data are there now. This means that deliverable D3.1.5 is now complete with all RT3 ERA40-based simulations online. Congratulations to us all! 3/9/2007: I have started the uploads of ICTP and HC data now. There will also be replacements of many HC 50km files. Erasmo's list of corrections: Data with wrong grid info in the header: wap, ua and va (all levels), wss, wssmax Data in incorrect unit: rh (all levels), hurs, hursmax, hursmin Incomplete timeseries: tdps Wrong value of mdi mrsos (all levels), tso (all levels), evspsblpot, hfso, mrso, mrros, mrross, sic, tsi, as, clisccp (all levels). Also from UCLM I have received a disk. All 25km data will be replaced, and for the 50km data the following: 24H: tso1 for the first decade. It was missing in our first submission. 6H: 8 files, corresponding to 500 and 1000 hPa geopotential. 30/8/2007: Two missing months in the DMI 25km data have been filled in (199401 and 199403). The monthly means are being calculated and uploaded. The missing data sets from HC and ICTP have arrived and will be uploaded in the near future. 21/8/2007: The Danish 25km data are being uploaded at the moment and should be online tomorrow. The link to the Ouranos data was broken, but is now fixed; note that the geopotential height in the Ouranos data is in units of dekameters, i.e., 10 times too small in numbers. This will be fixed in a while. 13/7/2007: With a bit of a delay from my side the INM 25km ERA40 data are being uploaded now. 11/7/2007: The CNRM wind speed error is now corrected. 25km ERA40 data from UCLM as well as RT2B data from CNRM are being uploaded at the moment and will be available shortly. The annoying error that the data were not password-restricted is hopefully solved now. Tell me about any problems! 4/7/2007: Some erroneous MM files from ICTP have now been corrected. I have forgotten to tell that there is a factor of 2 error in CNRM wind speeds (not ua and va). They will be corrected! 28/6/2007: There are data from our Canadian friends of Ouranos now. Thanks very much!! Note that the daily data have been interpolated to the common grid. The original grid is polar stereographic. 25/6/2007: We have received the ETHZ 25km RT3 data now, as well as monthly means of their 50km simulation. 20/6/2007: There are now new versions of the INM data files. Have a look! 18/6/2007: There seems to be problems with the INM data files. It is being looked into. 23/5/2007: Finally, the 50km archive has been completed with the upload of data from the Hadley Centre. Note the new link a bit further up the page to the table of experiments. 30/4/2007: The 50km ICTP data are online. 17/4/2007: The MPI data and the corrected SMHI data are available now. 16/4/2007: Erik van Meijgaard has found inconsistencies in several data sets. The SMHI data are being replaced by ones where the time variable is the same as for the other institutes. I am behind schedule in fixing flaws in other data sets; I apologize for this, and I will try to catch up. Some issues are: Precipitation from DMI has the wrong units (mm/day instead of mm/s (=kg/m^2/s)). North pole latitude and longitude is interchanged in a lot of files The CNRM output of monthly averaged files has as time-unit: "months since 1950-1-1 00:00" which should be "months since 1950-01-01 00:00". Their time-units in the daily files is correct: days since 1950-01-01 The UCLM files do not contain a grid_mapping variable "Lambert_Conformal". Instead these files contain a global attribute grid_mapping="lambert_conformal_conical" without parameter values. In the namegiving of the files Erik found the following ambiguties so far. i) Some names have a hyphen '-' between institute name (e.g. CLMN-RM4.5), some don't (e.g. SMHIRCA) ii) We agreed that the emission scenario under ERA40 should be indicated as CTL, some however use CTR (SMHI,UCLM, maybe more) iii) In the files with monthly averages some files have the period included (e.g. CNRM-RM4.5_CTL_ERA40_MM_50km_1958-2001_rsds.nc), most however don't . The latter format was agreed upon. iv) The "CRU"-label should be attached to the resolution with a hyphen, 25km-CRU or 50km-CRU. GKSS uses an underscore. Moreover GKSS puts the resolution in front of the time indicator, but it should be at the back. v) In the monthly files of the GKSS-CLM model the filenames contain an additional label to indicate what type of fields are imported into the monthly averaging (e.g. MM_DM, or MM_UCT0). None of the other models does so. From a lot of institutes the MM-files are missing, from even more institutes the MM-CRU files are missing. The MPI 25km data are being uploaded at the moment and should be there today. 9/3/2007: We now have 25km data from SMHI and from CHMI, as well as 50km data from INM. More data are coming as well. I try to update the table as the data come in. 7/3/2007: With my apologies for being late in uploading: here is the resume of the RT3 meeting at the General Assembly in Lund, which Markku mailed me a month ago. 25/1/2007: I am currently uploading 25km KNMI data. Hence I have moved not just the KNMI 50km data, but all data to subdirectories with the names 25km and 50km as appropriate. The clickable table has been updated, and all links below have also been fixed. 25/1/2007: Burkhardt Rockel's famous and very useful converson program to RT3-standard netCDF is finally here at the web site. 19/1/2007: The MPI data are now complete. At the same time I have received data from the ETHZ, which is also online now. One more development is that I have finally constructed a clickable table from which you can access the data through OpenDAP and/or direct download. I have put in contact information, which you are welcome to correct. Experiment acronyms link to model metadata. I hope that you will check the page for errors. 18/1/2007: For those interested in the PRUDENCE archive, I can tell that the DMI 12km daily data are now online. Recall that this is a standard PRUDENCE simulation with 4 times the resolution, using the Baltic SST's from the RCAO simulation. This means that this pair, F12/S12, corresponds to the HC1/HS4 simulation pair in 50km resolution. Note that each field is split into 3 decadal files with indices corresponding to the decade. Direct download from http://prudence.dmi.dk/data/daily/DMI/F12 and DODS download from http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/prudence/daily/DMI/F12 and correspondingly for S12. 15/1/2007: Finally the netCDF software at this server has been upgraded to version 3.6. This means that the data sets can finally be accessed with DODS/Opendap. While you are waiting for me to create a clickable table, you can use the URL http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/ as entry point. Recall that you may have to wait for a while before the server responds, since it has to unpack the compressed file before it is possible to read its header! The 50km data from the MPI are being uploaded at the moment in the expected place. 2/1/2007: Happy new year to everyone! My Christmas gift was a USB disk with the CNRM 25km ERA40 simulation data. I have moved the 50km data to http://ensemblesrt3.dmi.dk/data/ERA40/CNRM/50km. 19/12/2006: We have received data from SMHI and also here from DMI. Note that the latter have been made with the model that will be replaced with a new version soon, such that this simulation will also be replaced. 1/12/2006: Link to the A2 simulation from C4I is here. Unfortunately our DODS can not read the files yet, since we use entCDF 3.5 and the C4I files are 3.6. This will be changed shortly! Currently I am uploading a new version of the KNMI data with an error being corrected. See the global attribute "comments" for explanation, and the attribute "realization" to see what version a file is. The new version will take the default position http://ensemblesrt3.dmi.dk/data/ERA40/KNMI/50km, whereas the old version has been moved to http://ensemblesrt3.dmi.dk/data/ERA40/KNMI_version1/50km. We have also received monthly means for the CNRM simulation, and we have data from the GKSS now, of course in http://ensemblesrt3.dmi.dk/data/ERA40/GKSS/50km. I shall make a clickable table like the prudence one shortly. Finally, I have made files "md5sums" in each data directory. You can check the vconsistency of a downloaded file by running md5sum on it and comparing. Have fun! 6/11/2006: We have received ERA40 data from UCLM. Direct access and DODS/OpenDAP access is available. Furthermore, the Irish C4I data in 25km resolution for ERA40 and also for a transient A2 simulation (link will follow). 13/10/2006: The KNMI data apparently has a parameter error in the soil scheme. It has not been decided if ti is so serious that the run will have to be redone. But be forewarned that the KNMI data may not be what you should use. We will let you know asap. 13/10/2006: Now we also have KNMI data there, they can be accessed directly at http://ensemblesrt3.dmi.dk/data/ERA40/KNMI/50km or through DODS/OpenDAP as http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/ERA40/KNMI/50km. The data are restricted to project participants for the moment being; they will be public at the latest when ENSEMBLES reaches its end. The Hadley Centre has produced some plots describing their experiments. Get the contents of http://ensemblesrt3.dmi.dk/HC 4/9/2006: The people who have delivered test data have all put ISCCP cloud data in different files for different levels. So, let's do it that way. Remember the nomenclature clisccpH, clisccpM, and clisccpL. 28/8/2006: We have the first data set available now! The CNRM RT3 run (ERA40) can be accessed directly at http://ensemblesrt3.dmi.dk/data/ERA40/CNRM/50km or through DODS/OpenDAP as http://ensemblesrt3.dmi.dk/cgi-bin/nph-dods/data/ERA40/CNRM/50km. The data are restricted to project participants for the moment being; they will be public at the latest when ENSEMBLES reaches its end. Please report errors or deviations from how YOU thought it was going to be; I am not necessarily correct. NOTE that the data is stored in gzip'ed format. This is to your advantage when you download entire datasets. However, when using DODS you have to be patient, since the entire file will have to be unzipped before you can see the DODS entry page! 22/8/2006: Lots of small questions keep popping up. Some examples: What is the "scenario" part of the file name for ERA40? CNRM started out with "CTL", i.e. file names like CNRM-RM4.5_CTL_ERA40_12H_50km_196209_va700.nc. You could do the same. What about soil levels and ISCCP cloud levels in file names? It has been suggested to use numbers starting at the top for soil levels, e.g., ..._tso2.nc and capital letters "L", "M", and "H" for the 3 ISCCP layers, e.g., _clisccpL.nc. File names of monthly means of sub-daily fields, I think should just have _MM_ in their names. How we shall describe them in the netCDF attributes, I will post when I have found out. Should momentum flux include gravity wave drag? The consensus (?) I think is to just use the turbulent flux from the boundary layer scheme. Which fields should be interpolated with land-sea discrimination? I suggest that all diagnostic surface fields, including 2-meter temperature and 10-meter wind should be discriminated. Surface pressure, upper-air fields etc. should not. 24/4/2006: I have generated a land area fraction file and an orography file that you can use for the interpolation of monthly RCM output. Unless you have any protests I suggest that we use a lapse rate of 6.5 degrees/km for any temperature for the interpolations. 20/4/2006: Hopefully final minutes from the RT3 meeting in Copenhagen 13-14/3/2006 are now available. 19/4/2006: Some inaccuracies have been pointed out by Anders Ullerstig: The CRU-grid is 278x170 points. I mistyped the file name convention, as I forgot the time period. Please start on January 1st in years ending with "1", and please use the numbering of days indicated in the list, i.e., days after 1-1-1950. Monthly means should be collected into one file for the whole simulation period. 30/3/06, updated 3/4/2006 and again 7/4/2006: We now have an updated and hopefully final RCM output list after a lot of work by Burkhardt and Silke and also myself. As mentioned in my mail, some further requirements are: Daily data should be stored in its original lattice in files with a decade in each, with a naming convention like: "<institute/model acronym>_<scenario>_<short driving model/simulation number acronym>_<time sampling>_<resolution and interpolation>_<period>_<field name and level>", e.g. DMIHIRHAM_A1B_ECH51_DM_25km_2031-2040_t850.nc Where the convention about sampling is: MM:monthly mean, DM:daily mean, DC:diurnal cycle, 6H:6 hourly, 12h:12hourly Furthermore, you should also deliver monthly means on the original grid, i.e. with names like DMIHIRHAM_A1B_ECH51_MM_25km_t850.nc . These data should also be delivered interpolated to a regular CRU-like 0.25-degree grid with the definition [-23.875,45.375,29.125,71.375,0,-90] and 278x170 points (sorry for the previous typo). Exact specification of driving model in global "comments" attribute _FillValue=missing_value=1e30f for the interpolated fields. Names for these fields should be in the style DMIHIRHAM_A1B_ECH51_MM_25km-CRU_t850.nc (note the dash!). I will make land-sea-mask and orography files for the regular area shortly. These conventions are heavily inspired by the conventions already in place for the GCM people. Coordinates rlon, rlat, lon, lat should be defined as in PRUDENCE (see the list). 23/2/06: I have made slight changes in the output list (the old one looked like this) due to synchronization with the GCM database, which itself wants to synchronize with the IPCC archive. The changes are: Precipitation and evaporation are now average fluxes, measured as kg m-2 s-1. Integrated liquid cloud water has now been replaced by liquid+frozen water; and these integrated amounts are now measured in kg m-2, as is integrated specific humidity. Field capacity is now an amount of water, kg m-2, and not a volume fraction. Global radiation has been removed, as nobody knows how it is different from downward SW radiation. Standard_name has been changed where relevant (I hope). Comments are of course very welcome and may be discussed at the upcoming meeting. Note the CF convention consistency checker at http://titania.badc.rl.ac.uk/cgi-bin/cf-checker.pl! -I have not tried it myself, but Burkhardt knows about it and has recommended it. 22/2/06: We now also have documents with transportation instructions and hotel information. 20/2/06: Participants can find the agenda of the upcoming RT3 meeting in Copenhagen here. 12/1/06: A revised output list with netCDF standard_name attributes according to the CF convention can be found here in Excel format; sorry about the delay by me in posting it. Happy outputting! 5/12/05: The minutes of the RT3 meeting in Athens are available here. Note also that there will be an RT3 meeting on March 13-14 at the Danish Meteorological Institute. 24/8/05: The area definition and output list is hopefully close to a final state now. You can find it here. 18/5/05: Some links relevant to the specification of non-climatic environmental changes are available on the internal pages. 17/5/05: There is now a document describing the output and domain restrictions to which the RT3 RCM simulations should adhere. Read it carefully! 22/3/05: Planned regional climate model simulations from RT3 and RT2B will provide results for other RTx, such as RT2B, RT5, and RT6. Due to archiving considerations, the amount of output needs to be planned so that it does not become excessive, but nevertheless satisfies the foreseen needs. RT3 and RT2B aim to provide such common output from the simulations. Some groups will store additional data and on even higher resolution in time. RT3 invites all RTs to check and comment on the list of proposed output. Column "RT3" contains the suggested common output. Please notify by April 30 Ole Bøssing Christensen at DMI with comments and additional wishes. 10/2/05: The first RT3 meeting was held at the DMI in Copenhagen 7-8 February. The minutes should be up in a little while. 25/2/05: The minutes and a few talks from the Copenhagen meeting are now available from the newly inaugurated Member's-only page. Please login as you do at the main site.

Ensembles RT3

Research theme 3 of the ENSEMBLES project has the responsibility for providing improved climate model tools developed in the context of regional models, first at spatial scales of 50 km at a European-wide scale and later also at as high a resolution as 20 km for specified sub-regions ... RT3 will produce a multi-model ensemble based system for regional climate prediction from seasonal to decadal and longer time scales... (quoted from the description of work)