Engineering Blog

Blog posts tagged 'Infra'

Under the Hood: Building the App Center recommendation engine

Posted about 5 years ago
blog post · Infra · Data · Platform

As more apps on Facebook Platform have launched over the years, the types of apps available have become more diverse, making it crucial that people see the most relevant and highest quality apps in channels like news feed and App Center. Read more...

Sean LynchEngineering

Monitoring cache with Claspin

Posted about 5 years ago

When I started at Facebook, I joined the newly formed cache performance team in production engineering. Our goal was to get a handle on the health of our various cache systems and to facilitate quick troubleshooting, starting with answering the question, "Is this problem being caused by the cache?". Read more...

Ari ChivukulaEngineering

A faster, better link shim

Posted about 5 years ago
blog post · Infra · Security

Earlier this year, the Site Integrity team wrote about a tool called "link shim" to warn people about potentially spammy or malicious links. While this tool did an excellent job of protecting people, this implementation caused a delay while your browser performed an extra round trip to Facebook's servers in order to check the link for maliciousness and hide the referrer. Read more...

Jonathan DannEngineering

Under the hood: Rebuilding Facebook for iOS

Posted about 5 years ago
blog post · Infra · Mobile · iOS

Today we released a new version of Facebook for iOS that's faster, more reliable, and easier to use than ever before. The development of this new app signals a shift in how Facebook is building mobile products, with a focus on digging deep into individual platforms. To understand how we approached this shift, let's take a look at how Facebook has evolved on mobile. Read more...

Adam WolffEngineering at Facebook

Under the hood: Improving messages

Posted about 5 years ago
blog post · Infra · Messages · Performance

Starting today, we're rolling out improved features and a new look for messages. Behind the scenes, we've also been improving the reliability of messages across the site. To address issues with disconnection, incorrect message counts, and missed and duplicated messages, we recently undertook an effort we called the "mercury project.". Read more...

Chuck RossiDirector of Engineering at Facebook

Ship early and ship twice as often

Posted about 5 years ago
blog post · Infra

When I wrote about Facebook's release process earlier this year, I stressed how fast we build things here and described how we push new code to facebook.com every day. In fact, I closed with the advice to "ship early and ship often.” Last week, in conjunction with the opening of our engineering office in London, we decided to double the release speed of facebook.com and indeed "ship often.". Read more...

Paul TarjanWeb hacker at Facebook

Under the Hood: Timeline apps behind Facebook engineering

Posted about 5 years ago
blog post · Web · Infra · Data · Culture · Open Source · Timeline

A big part of working at Facebook is dogfooding our own products. Before new features roll out to the public, our team uses them frequently and thoroughly to figure out what we can do better. So when we started building Open Graph, we were all eager to give Open Graph apps a test run by creating our own and making the internal tools we were already using more social. Here's a look at some of our favorite in-house Facebook Open Graph apps for work and play, and what we've learned along the way that can help you, too. Read more...

Andrew RyanEngineering

Under the Hood: Hadoop Distributed Filesystem reliability with Namenode and Avatarnode

Posted about 6 years ago
blog post · Infra · Data · Storage · Open Source

The Hadoop Distributed Filesystem (HDFS) forms the basis of many large-scale storage systems at Facebook and throughout the world. Our Hadoop clusters include the largest single HDFS cluster that we know of, with more than 100 PB physical disk space in a single HDFS filesystem. Optimizing HDFS is crucial to ensuring that our systems stay efficient and reliable for users and applications on Facebook. Read more...

Phil DibowitzProduction Engineer at Facebook

Under the Hood: Network implementation for World IPv6 Launch

Posted about 6 years ago
blog post · Infra · Networking and Traffic

As more and more computers, smartphones, and other devices come online, transitioning to IPv6 is critical to ensuring the future scalability of the Internet. The world is currently operating on IPv4, but we have run out of IP addresses. IPv6, the next version of this protocol, contains significantly more addresses and will allow the Internet to grow indefinitely. As Computer History Museum docent Dick Guertin put it, we could assign an IPv6 address to every atom on the surface of the earth, and still have enough addresses left to do another 100+ earths. Read more...

Jordan DeLongEngineering

Folly: The Facebook Open Source Library

Posted about 6 years ago
blog post · Infra · Backend · Open Source · Compute · Development Tools · Performance

Facebook is built on open source from top to bottom, and could not exist without it. As engineers here, we use, contribute to, and release a lot of open source software, including pieces of our core infrastructure such as HipHop and Thrift. Read more...

Adam SimpkinsEngineering

Back-end build systems and toolchain: Adam Simpkins

Posted about 6 years ago
blog post · Infra · Culture · Backend · Compute · Optimization

Adam Simpkins is a software engineer on the traffic infrastructure team. Read more...

Chuck RossiDirector of Engineering at Facebook

Release engineering and push karma: Chuck Rossi

Posted about 6 years ago
blog post · Infra · Culture

Facebook updates the site with new features, product improvements, and bug fixes every work day. This can sometimes be a huge challenge, given that there are hundreds of engineers working on thousands of changes every week, and many of those changes immediately impact the over 800 million people using Facebook worldwide. But Chuck Rossi, who has worked in release engineering for over 20 years and started as Facebook's very first release engineer in 2008, helps make it all happen. Read on to learn about the team behind the daily push and the tools and processes they built to make it possible. Read more...

Mary PimenovaEngineering

Moving Fast and Staying Reliable: Mary Pimenova

Posted about 6 years ago

Mary Pimenova is a recent grad and software engineer on the Site Performance team. Read on to learn how her team keeps the site reliable, how she got her start, and her advice for people breaking into software engineering. Read more...

Ryan MackEngineering

Under the Hood: Improving Facebook Photos

Posted about 6 years ago
blog post · Web · Infra · Photos

Two of my passions in life are travel and photography. After working hard to build Facebook Timeline, I spent a few weeks traveling around Australia with my wife and camera. Inside the Sydney Opera house I took a photo that I just couldn't wait to share with my friends. But when I uploaded it to Facebook the seat ended up looking way too red. It was a subtle change, but it bothered me enough to investigate. Read more...

Karan ManglaSoftware engineer at Facebook

Under the Hood: Building the Location API

Posted about 6 years ago
blog post · Data · Infra · Platform

Earlier this week, we added the ability to tag location in stories published from apps on the open graph. Like with any update you make from your composer, location can now be added to any photo, link, or update written from an app back to Facebook, allowing people to add more context to their stories. Read more...

MySQL and Database Engineering: Mark Callaghan

Posted about 6 years ago

Mark Callaghan joined Facebook in 2009. Now, working from home in Oregon on the database infrastructure team, he does whatever it takes to keep the database running and users like Trekkie George Takei, a favorite person to get updates from amongst Mark's team, happy. Read on for Mark's insights into fast-storage challenges, Facebook's MySQL roadmap, and more. Read more...

Raylene YungEngineering

From News Feed to Timeline: Q&A with Raylene Yung

Posted about 6 years ago
blog post · Web · Infra · Culture · News Feed · Security · Timeline · Recruiting

Raylene Yung joined Facebook right out of school in 2009 and went to work on the News Feed team. After two years on News Feed, she worked on the Timeline, Friend Lists, and privacy teams. Read on to learn about the history of News Feed stories, how Raylene thinks about sharing on Facebook, and her recent transition into an engineering manager role. Read more...

Benjamin K. BillingsSoftware engineer at Facebook

Meet a Facebook Engineer: Ben Billings

Posted about 6 years ago
blog post · Culture · Infra · Performance

Ben Billings has worn many hats since coming to Facebook in 2008. He began by building internal tools to help the business run and then moved to Infrastructure, where he managed the Site Speed team for a year and a half. As of last week, Ben has made the choice to return to day-to-day coding as a software engineer on the Ads team. Read on to learn more about how his goals changed over the years and what he’s learned about balancing growth and site performance while moving fast. Read more...

Michael AdkinsSoftware engineer at Facebook

DMARC: Building Open-Source Email Authentication Technologies

Posted about 6 years ago
blog post · Infra · Security · Open Source · Optimization · User Experience

As one of the largest senders of email on the Internet, Facebook is also one of the largest phishing targets. After working at an ISP on email security and abuse issues for several years, I came to Facebook because I wanted to have a greater impact on the email ecosystem. Supported by Facebook’s commitment to open technologies, in 2010 I started working with a handful of other email security experts on a major anti-phishing effort called DMARC. Read more...

Clément GenzmerEngineering

My First Year Fighting Spam

Posted about 6 years ago
blog post · Infra · Security · User Experience · Performance · JavaScript

Fighting spam is really an arms race. As technology evolves, new threats emerge and keeping up is an absolute necessity. The Site Integrity team at Facebook works to protect people from spam, scams, account compromises, and other forms of abuse by building real-time classification systems that process millions of interactions per second and investigate and respond to new threats. Read more...

Mick JohnsonDirector, Product Management at Facebook

Under the Hood: Mobile Timeline

Posted about 6 years ago
blog post · Data · Infra · Mobile · Timeline

Completely rewriting one of the fundamental pages of mobile Facebook was a huge engineering task – and required a lot of design work to get a model that would scale to all the interfaces we needed to support. All the stories needed to be re-implemented for mobile, with new designs to suit smaller viewports, different styling to match the capabilities of different devices, browsers and platforms, and additional interactions unique to touch devices to help navigate all of the new content. Fortunately the back-end work handled both mobile and desktop just fine, and by f8 in September we had completely designed and built working versions of all the stories, tabs and interactions. We’d been working round the clock in Palo Alto and Seattle for months, so to finally watch mobile Timeline scroll smoothly up the screen during the keynote was an amazing feeling. Read more...

Ryan MackEngineering

Building Timeline: Scaling up to hold your life story

Posted about 6 years ago
blog post · Data · Infra · Web · Timeline · User Experience

Timeline isn’t just a bold new look for Facebook­—it’s also the product of a remarkably ambitious engineering effort. While our earlier profile pages surfaced a few days or weeks of activity, from the onset we knew that with Timeline we had to think in terms of years and even decades. At a high level we needed to scan, aggregate, and rank posts, shares, photos and check-ins to surface the most significant events over years of Facebook activity. Read more...

Meet a Facebook Fellow: Marek Olszewski

Posted about 6 years ago
blog post · Culture · Infra · Research · HipHop · Academics

The Facebook Fellowship program supports Ph.D. students doing groundbreaking computer science research for one academic year. Over the past two months, the 2011-2012 Facebook Fellows have been gearing up for the end of their year with visits to Facebook HQ to present their research and meet the team. Here's a look into one Facebook Fellow's experience in Palo Alto. Read more...

Jason EvansEngineering

The HipHop Virtual Machine

Posted about 6 years ago
blog post · Infra · Open Source · HipHop · PHP · Performance · Languages

Read more...

Minghui YangSoftware engineer at Facebook

Making HPHPi Faster

Posted about 6 years ago
blog post · Infra · Web · PHP · HipHop · Open Source · Performance · Development Tools · Languages · C++ · Optimization · Caching · Testingmore

Read more...

Justin BishopHacker (computing) at Facebook

Watir to WebDriver: Unit Test Frameworks

Posted about 6 years ago
blog post · Infra · Testing

Watir Makes Waves. Read more...

Alethea PowerSite Reliability Engineer at Facebook

Making Facebook Self-Healing

Posted about 6 years ago

When your infrastructure is the size of Facebook’s, there are always broken servers and pieces of software that have gone down or are generally misbehaving. In most cases, our systems are engineered such that these issues cause little or no impact to people using the site. But sometimes small outages can become bigger outages, causing errors or poor performance on the site. If a piece of broken software or hardware does impact the site, then it's important that we fix it or replace it as quickly as possible. Even if it's not causing issues for users yet, it could in the future so we need to take care of it quickly. Read more...

Keep Updated

Stay up-to-date via RSS with the latest open source project releases from Facebook, news from our Engineering teams, and upcoming events.

Subscribe
Facebook © 2017