---
title: "A guide to how Google builds its datacenters"
publication: "StatusCode Weekly"
issue: 193
published_at: "2018-11-28"
canonical_url: "https://weekly.statuscode.com/issues/193"
---

The latest Web operations, HTTP, and Web performance news       

#193 — November 28, 2018 

[Read on the Web](https://webopsweekly.com/issues/193)   

Web Operations Weekly 

[![\](https://res.cloudinary.com/cpress/image/upload/w_1280,e_sharpen:60/xm6jaypwh8shemqmop6g.jpg)](http://highscalability.com/blog/2018/11/14/new-the-datacenter-as-a-computer-designing-warehouse-scale-m.html)  

['The Datacenter as a Computer: Designing Warehouse-Scale Machines'](http://highscalability.com/blog/2018/11/14/new-the-datacenter-as-a-computer-designing-warehouse-scale-m.html) — If getting a very thorough tour of how Google structures its datacenters for its collossal workloads sounds interesting to you, you’ll _love_ this. It’s fascinating reading and packed with diagrams and photos. [PDF here.](https://doi.org/10.2200/S00874ED3V01Y201809CAC046) 

High Scalability   

[Five Lessons Learned From Writing Over 300,000 Lines of Infrastructure Code](https://blog.gruntwork.io/5-lessons-learned-from-writing-over-300-000-lines-of-infrastructure-code-36ba7fadeac1) — Bills itself as a _“concise masterclass on how to write infrastructure code”_. 

Yevgeniy Brikman   [![\](https://copm.s3.amazonaws.com/26a42b49.png)](https://circleci.com/blog/announcing-orbs-technology-partner-program/?utm_source=cooperpress&utm_medium=newsletter&utm_campaign=nov18&utm_content=webops-weekly) 

[Expanding the CircleCI Ecosystem: Orbs and the Technology Partner Program](https://circleci.com/blog/announcing-orbs-technology-partner-program/?utm_source=cooperpress&utm_medium=newsletter&utm_campaign=nov18&utm_content=webops-weekly) — CircleCI just announced its first-ever Technology Partner Program. Our platform is now open to partners to contribute Orbs - first-in-industry configuration packages for CI. 

CircleCI sponsor   

[WebSockets: A Conceptual Deep-Dive](https://www.ably.io/concepts/websockets) — A technical look at the world of WebSockets, the browser technology that can provide a fast, full-duplex persistent connection between a server and client. 

Ably   

[AWS Introduces EC2 Instances Powered By Its Own 'Graviton' ARM Processors](https://aws.amazon.com/blogs/aws/new-ec2-instances-a1-powered-by-arm-based-aws-graviton-processors/) — AWS continues its relentless release of new EC2 instance types, this time powered by ARM-based CPUs of its own design. If this intrigues you, one of AWS’s VPs [spoke about Amazon’s ‘custom silicon journey’](https://www.youtube.com/watch?v=-AzPyNFQMJ4) earlier this year. 

Jeff Barr (AWS)   

[Herding the DNS Camel](https://ietf.org/blog/herding-dns-camel/) — Bert Hubert, the founder of PowerDNS and author of [RFC 5452](https://tools.ietf.org/html/rfc5452) (_Measures for Making DNS More Resilient against Forged Answers_), shares his views on forces influencing DNS protocol development. 

IETF  

💻 Jobs  

[DevOps Engineer at Clue (Permanent)](https://www.workable.com/j/1737B3EDBC) — Clue is at a pivotal and exciting point in our journey. With 10 million MAUs globally and fast-paced growth, we're building our platform, monetization, and team to support our continued success. 

Clue by Biowink   

[Join Our Career Marketplace & Get Matched With A Job You Love](https://www.hired.com/webops) — Through Hired, software engineers have transparency into salary offers, competing opportunities, and job details. 

Hired  

📘 Tutorials  

[How to Build a Serverless Report Server with Azure Functions and SendGrid](https://medium.freecodecamp.org/how-to-build-a-serverless-report-server-with-azure-functions-and-sendgrid-3c063a51f963) — Severless.. server? Nonetheless, this is a fun walk through what’s involved in using Azure Functions’ timer triggers to fire up a process that builds and emails a report. 

Burke Holland   

[What's in a Docker Image?](https://cameronlonsdale.com/2018/11/26/whats-in-a-docker-image/) — Not only does it answer the question but shows _how_ to dig around. 

Cameron Lonsdale   

[Transferring Your Linux Images to DigitalOcean with Custom Images](https://www.digitalocean.com/community/tutorials/how-to-create-an-image-of-your-linux-environment-and-launch-it-on-digitalocean?utm_medium=display&utm_source=cooperpress&utm_campaign=2018_Brand_Businesses100&utm_content=webops+weekly+11-28) — Create and compress Linux and Unix-like virtual disk images and launch them on DigitalOcean Droplets. 

DigitalOcean sponsor   

[Progressive Service Architecture at Auth0](https://auth0.com/blog/progressive-service-architecture-at-auth0/) — Learn how to create a mature service architecture for scalability and high availability by building its topology progressively. 

Dan Arias   

[RFC 8484: DNS Queries over HTTPS (a.k.a. DoH)](https://tools.ietf.org/html/rfc8484) 

IETF  

💬 Stories & Opinions  

[How GitLab Spent Two Weeks Hunting An NFS Bug in the Linux Kernel](https://about.gitlab.com/2018/11/14/how-we-spent-two-weeks-hunting-an-nfs-bug/) — An in-depth recap of debugging a GitLab issue that culminated in a patch for the Linux kernel. 

Stan Hu (GitLab)   

[Automating Terraform: Infrastructure as Code as a Service](https://blog.scottlogic.com/2018/10/23/automating-terraform-abstracting-terraform-behind-a-web-service.html) 

Matthew Smith   

[Overload Control for Scaling WeChat Microservices](https://blog.acolyer.org/2018/11/16/overload-control-for-scaling-wechat-microservices/) — WeChat is a _very_ popular China-based chat system and this paper gives a look behind the scenes as to how it works. 

the morning paper   

[Reliable Webhooks Using Serverless Architecture](https://medium.com/square-corner-blog/reliable-webhooks-using-serverless-architecture-e009a2096732) — _“How we made our webhooks more reliable using SQS and Lambda”_ 

Victor Zhu   

[Can SNMP (Still) Be Used to Detect DDoS Attacks?](https://hackernoon.com/can-snmp-still-be-used-to-detect-ddos-attacks-32b03aa9df8a) — SNMP is a protocol for collecting info about devices on IP networks, but SNMP polling is no longer a good way to detect DDoS attacks. 

Pascal Geenens   

[When Not to Use Microservices](https://www.feval.fr/posts/microservices/) 

Charles Féval   

[Towards Usable Checksums: Automating the Integrity Verification of Web Downloads for the Masses](https://blog.acolyer.org/2018/11/28/towards-usable-checksums-automating-the-integrity-verification-of-web-downloads-for-the-masses/) — A look at an academic paper that addresses the problem of verifying the authenticity of downloads. 

the morning paper  

🔧 Tools & Code  

[Amazon CloudWatch Logs Insights: Interactive Log Analytics on AWS](https://aws.amazon.com/blogs/aws/new-amazon-cloudwatch-logs-insights-fast-interactive-log-analytics/) — In a move that’s likely to tread on a lot of other services’ toes, AWS is now providing a fully managed service for ‘cloud-scale’ log analysis. 

Jeff Barr   

[AWS Transfer for SFTP: A Fully Managed SFTP Service for Amazon S3](https://aws.amazon.com/blogs/aws/new-aws-transfer-for-sftp-fully-managed-sftp-service-for-amazon-s3/) — At 30 cents an hour, you either better have a need for a $200 per month SFTP server or provision it as needed. 

Jeff Barr   

[Shop Like a Developer – Discover and Experiment with Hot New Cloud Services 🔥](https://www.manifold.co/v2?utm_campaign=WebOps&utm_source=newsletter&utm_medium=sponsorship&utm_content=Nov28) 

Manifold sponsor   

[AWS Unveils New C5n EC2 Instances with 100 Gbps Networking](https://aws.amazon.com/blogs/aws/new-c5n-instances-with-100-gbps-networking/) — If you have too much funding and too much data to shift, the solution is here. 

Jeff Barr   

[Elasticsearch 6.5.0 Released](https://www.elastic.co/blog/elasticsearch-6-5-0-released) — The hugely popular search server and document database takes another step forward with a new ODBC driver for Windows, new query filters, improved audit logging, minimal snapshots (smaller snapshots that don’t include large generated indexes), and cross-cluster replication (paid customers only, alas). 

Elastic   

[Generate Self-Signed SSL Certificates for Local Development on a Mac](https://github.com/kingkool68/generate-ssl-certs-for-local-development) — A bash script for generating trusted self-signed SSL certs for local development. 

Russell Heimlich         

Curated by [Cooperpress](https://cooperpress.com/) 

[Change your email address](https://webopsweekly.com/edit_subscription/*|UID|*) or[Stop getting this newsletter](https://webopsweekly.com/leave/*|UID|*) 

© Cooper Press Ltd · Fairfield Enterprise Centre, Louth, LN11 0LS, United Kingdom