{"id":3315,"date":"2015-01-28T15:07:53","date_gmt":"2015-01-28T14:07:53","guid":{"rendered":"http:\/\/news.embl.de\/?p=3315"},"modified":"2021-07-13T12:00:40","modified_gmt":"2021-07-13T10:00:40","slug":"1501-datacentre-move","status":"publish","type":"post","link":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/","title":{"rendered":"Moving 20 Petabytes"},"content":{"rendered":"\n

By Ewan Birney<\/h3>\n\n\n\n

EMBL-EBI’s data resources are built on a constantly running compute and storage infrastructure. Over the past decade that infrastructure has grown exponentially, keeping pace with the rapid growth of molecular data and the corresponding need for computation. Terabytes of data flow every day on and off our storage systems, making up the hidden life-blood of data and knowledge that permeates much of modern molecular biology.<\/p>\n\n\n\n

There is a somewhat bewildering complexity to all of this. We have 57 key resources: everything from low-level, raw DNA storage (ENA<\/a>) through genome analysis (Ensembl<\/a> and Ensembl Genomes<\/a>), complex knowledge systems (UniProt<\/a>) and 3D protein structures (PDBe<\/a>). At minimum, over half a million users visit at least one of the EMBL-EBI websites each month, making 12 million web hits and downloading 35 Terabytes each day. Each resource has its own release cycle, with different international collaborations (for example, INSDC<\/a>, wwPDB<\/a>, ProteomeXchange<\/a>) handling the worldwide data flow.<\/p>\n\n\n\n

To achieve consistent delivery, we have a complex arrangement of compute hardware distributed around different machine rooms, some at Hinxton and some off site. Around two years ago we started the process to rebid our machine room space, and last year Gyron, a commercial machine-room provider in the southeast of England, won the next five-year contract<\/a>. This was good news for efficiency (Gyron provided a similar level of service but at a sharper price) but posed an immediate problem for EMBL-EBI’s systems, networking and service teams: to wit, how we were going to move our infrastructure without disruption?<\/p>\n\n\n\n

To read the full blog post, visit Ewan’s blog: Bioinformatician at Large<\/a><\/p>\n\n\n\n

\n\n\n\n

If you’d like to know a bit more about\u00a0the people behind the move, you might enjoy an article in Nature News and Comment<\/em>, Not Your Average Technician<\/a>, featuring EMBL-EBI data centre engineer Dawn Johnson.<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.<\/p>\n","protected":false},"author":16,"featured_media":3318,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3],"tags":[368,152,782],"embl_taxonomy":[],"class_list":["post-3315","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lab-matters","tag-birney","tag-blog","tag-database"],"acf":{"article_intro":"

A blog post by Ewan Birney, Joint Associate Director of EMBL-EBI<\/a>, reflects on the challenges of moving\u00a0a massive data-centre.<\/p>\n","related_links":[{"link_description":"Moving 20 Petabytes: blog post by Ewan Birney, 13 January 2015","link_url":"http:\/\/genomeinformatician.blogspot.co.uk\/2015\/01\/moving-20-petabytes.html"},{"link_description":"Nature News & Comment: Not your average technician, 28 January 2015","link_url":"http:\/\/www.nature.com\/news\/not-your-average-technician-1.16785"}],"article_sources":false,"vf_locked":false,"featured":false,"color":"#007B53"},"embl_taxonomy_terms":[],"yoast_head":"\nMoving 20 Petabytes | EMBL<\/title>\n<meta name=\"description\" content=\"A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Moving 20 Petabytes | EMBL\" \/>\n<meta property=\"og:description\" content=\"A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\" \/>\n<meta property=\"og:site_name\" content=\"EMBL\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/embl.org\/\" \/>\n<meta property=\"article:published_time\" content=\"2015-01-28T14:07:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-07-13T10:00:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"620\" \/>\n\t<meta property=\"og:image:height\" content=\"465\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Guest author(s)\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@embl\" \/>\n<meta name=\"twitter:site\" content=\"@embl\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Guest author(s)\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\"},\"author\":{\"name\":\"Guest author(s)\",\"@id\":\"https:\/\/www.embl.org\/news\/#\/schema\/person\/b4d9366b2ebe691c4015c64c3619205b\"},\"headline\":\"Moving 20 Petabytes\",\"datePublished\":\"2015-01-28T14:07:53+00:00\",\"dateModified\":\"2021-07-13T10:00:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\"},\"wordCount\":308,\"publisher\":{\"@id\":\"https:\/\/www.embl.org\/news\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg\",\"keywords\":[\"birney\",\"blog\",\"database\"],\"articleSection\":[\"Lab Matters\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\",\"url\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\",\"name\":\"Moving 20 Petabytes | EMBL\",\"isPartOf\":{\"@id\":\"https:\/\/www.embl.org\/news\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg\",\"datePublished\":\"2015-01-28T14:07:53+00:00\",\"dateModified\":\"2021-07-13T10:00:40+00:00\",\"description\":\"A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage\",\"url\":\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg\",\"contentUrl\":\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg\",\"width\":620,\"height\":465,\"caption\":\"EMBL-EBI Data Centre Engineer Dawn Johnson, who helped move the data centres. [Photo credit: Mary Todd Bergman]\"},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.embl.org\/news\/#website\",\"url\":\"https:\/\/www.embl.org\/news\/\",\"name\":\"European Molecular Biology Laboratory News\",\"description\":\"News from the European Molecular Biology Laboratory\",\"publisher\":{\"@id\":\"https:\/\/www.embl.org\/news\/#organization\"},\"alternateName\":\"EMBL News\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.embl.org\/news\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.embl.org\/news\/#organization\",\"name\":\"European Molecular Biology Laboratory\",\"alternateName\":\"EMBL\",\"url\":\"https:\/\/www.embl.org\/news\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.embl.org\/news\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2025\/09\/EMBL_logo_colour-1-300x144-1.png\",\"contentUrl\":\"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2025\/09\/EMBL_logo_colour-1-300x144-1.png\",\"width\":300,\"height\":144,\"caption\":\"European Molecular Biology Laboratory\"},\"image\":{\"@id\":\"https:\/\/www.embl.org\/news\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/embl.org\/\",\"https:\/\/x.com\/embl\",\"https:\/\/www.instagram.com\/embl_org\/\",\"https:\/\/www.linkedin.com\/company\/15813\/\",\"https:\/\/www.youtube.com\/user\/emblmedia\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.embl.org\/news\/#\/schema\/person\/b4d9366b2ebe691c4015c64c3619205b\",\"name\":\"Guest author(s)\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.embl.org\/news\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/300b9a1d66050ae03eaeb99869c6ebb30f5184b9468e92a2b3e7d28bc9cf742d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/300b9a1d66050ae03eaeb99869c6ebb30f5184b9468e92a2b3e7d28bc9cf742d?s=96&d=mm&r=g\",\"caption\":\"Guest author(s)\"},\"description\":\"Guest author(s)\",\"url\":\"https:\/\/www.embl.org\/news\/author\/guest-author\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Moving 20 Petabytes | EMBL","description":"A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/","og_locale":"en_US","og_type":"article","og_title":"Moving 20 Petabytes | EMBL","og_description":"A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.","og_url":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/","og_site_name":"EMBL","article_publisher":"https:\/\/www.facebook.com\/embl.org\/","article_published_time":"2015-01-28T14:07:53+00:00","article_modified_time":"2021-07-13T10:00:40+00:00","og_image":[{"width":620,"height":465,"url":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","type":"image\/jpeg"}],"author":"Guest author(s)","twitter_card":"summary_large_image","twitter_creator":"@embl","twitter_site":"@embl","twitter_misc":{"Written by":"Guest author(s)","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#article","isPartOf":{"@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/"},"author":{"name":"Guest author(s)","@id":"https:\/\/www.embl.org\/news\/#\/schema\/person\/b4d9366b2ebe691c4015c64c3619205b"},"headline":"Moving 20 Petabytes","datePublished":"2015-01-28T14:07:53+00:00","dateModified":"2021-07-13T10:00:40+00:00","mainEntityOfPage":{"@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/"},"wordCount":308,"publisher":{"@id":"https:\/\/www.embl.org\/news\/#organization"},"image":{"@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage"},"thumbnailUrl":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","keywords":["birney","blog","database"],"articleSection":["Lab Matters"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/","url":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/","name":"Moving 20 Petabytes | EMBL","isPartOf":{"@id":"https:\/\/www.embl.org\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage"},"image":{"@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage"},"thumbnailUrl":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","datePublished":"2015-01-28T14:07:53+00:00","dateModified":"2021-07-13T10:00:40+00:00","description":"A blog extract by Ewan Birney reflects on the challenges of moving a massive data-centre.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.embl.org\/news\/lab-matters\/1501-datacentre-move\/#primaryimage","url":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","contentUrl":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","width":620,"height":465,"caption":"EMBL-EBI Data Centre Engineer Dawn Johnson, who helped move the data centres. [Photo credit: Mary Todd Bergman]"},{"@type":"WebSite","@id":"https:\/\/www.embl.org\/news\/#website","url":"https:\/\/www.embl.org\/news\/","name":"European Molecular Biology Laboratory News","description":"News from the European Molecular Biology Laboratory","publisher":{"@id":"https:\/\/www.embl.org\/news\/#organization"},"alternateName":"EMBL News","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.embl.org\/news\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.embl.org\/news\/#organization","name":"European Molecular Biology Laboratory","alternateName":"EMBL","url":"https:\/\/www.embl.org\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.embl.org\/news\/#\/schema\/logo\/image\/","url":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2025\/09\/EMBL_logo_colour-1-300x144-1.png","contentUrl":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2025\/09\/EMBL_logo_colour-1-300x144-1.png","width":300,"height":144,"caption":"European Molecular Biology Laboratory"},"image":{"@id":"https:\/\/www.embl.org\/news\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/embl.org\/","https:\/\/x.com\/embl","https:\/\/www.instagram.com\/embl_org\/","https:\/\/www.linkedin.com\/company\/15813\/","https:\/\/www.youtube.com\/user\/emblmedia\/"]},{"@type":"Person","@id":"https:\/\/www.embl.org\/news\/#\/schema\/person\/b4d9366b2ebe691c4015c64c3619205b","name":"Guest author(s)","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.embl.org\/news\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/300b9a1d66050ae03eaeb99869c6ebb30f5184b9468e92a2b3e7d28bc9cf742d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/300b9a1d66050ae03eaeb99869c6ebb30f5184b9468e92a2b3e7d28bc9cf742d?s=96&d=mm&r=g","caption":"Guest author(s)"},"description":"Guest author(s)","url":"https:\/\/www.embl.org\/news\/author\/guest-author\/"}]}},"field_target_display":"embl","field_article_language":{"value":"english","label":"English"},"fimg_url":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","featured_image_src":"https:\/\/www.embl.org\/news\/wp-content\/uploads\/2015\/01\/JOHNSON_Dawn_data_centre.jpg","_links":{"self":[{"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/posts\/3315","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/comments?post=3315"}],"version-history":[{"count":14,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/posts\/3315\/revisions"}],"predecessor-version":[{"id":20891,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/posts\/3315\/revisions\/20891"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/media\/3318"}],"wp:attachment":[{"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/media?parent=3315"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/categories?post=3315"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/tags?post=3315"},{"taxonomy":"embl_taxonomy","embeddable":true,"href":"https:\/\/www.embl.org\/news\/wp-json\/wp\/v2\/embl_taxonomy?post=3315"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}