Tag: facebook

Posted on

The MySQL n00b: MyRocks: migrating a large MySQL dataset from InnoDB to RocksDB to reduce footprint

Enter RocksDB and the LSM (Log Structured Merge) technology: we are entering a new planet as far as data storage goes. The idea of an “append only” type of approach for writing database rows is something I never heard before. Databases usually are the most random writer ever! And although SSD will not suffer from write randomness, there are other factors that need to be taken into consideration. I’ll not go into more details about how LSM or RocksDB work, or why LSM is good for your SSD and your workload, as there is plenty of information about it on Mark’s blog (see above) or on the official page for RocksDB and for MyRocks (the RocksDB engine for MySQL) on GitHub; just check the Wiki there.

Source: The MySQL n00b: MyRocks: migrating a large MySQL dataset from InnoDB to RocksDB to reduce footprint

MyRocks and RocksDB sound like something worth exploring even for our small big data tables.

Posted on

Facebook releases Augmented Traffic Control, an open source tool for simulating network conditions

Augmented Traffic Control (ATC) is a tool to simulate network conditions. It allows controlling the connection that a device has to the internet. Aspects of the connection that can be controlled include:

bandwidth, latency, packet loss, corrupted packets, packets ordering

In order to be able to shape the network traffic, ATC must be running on a device that routes the traffic and sees the real IP address of the device, like your network gateway for instance.

https://github.com/facebook/augmented-traffic-control

This tool should be useful to anyone building an app on the network. CALI could use this to test behavior of Lessons on a bad connection, something we’ve been thinking about recently.

Posted on

Introducing “Yosemite”: the first open source modular chassis for high-powered microservers | Engineering Blog | Facebook Code

Introducing “Yosemite”: the first open source modular chassis for high-powered microservers | Engineering Blog | Facebook Code  https://code.facebook.com/posts/1616052405274961/introducing-yosemite-the-first-open-source-modular-chassis-for-high-powered-microservers-/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+feedsapi%2FBwPx+%28Hacker+News+Top+20+Full+feeds+by+FeedsAPI%29