Meta Introduces ‘Transparent Memory Offload’ Feature to Save Massive Memory on Linux Servers
- An American company made 0.7nm chips: EUV lithography machines can’t do it
- CVE-2007-4559 Python vulnerability ignored for 15 years puts 350,000 projects at risk of code execution
- RISC-V only takes 12 years to achieve the milestone of 10 billion cores
- 14000 cores + 450W: RTX 4080 graphics card perfectly replaces the RTX 3080
- Big upgrade: The difference between Bluetooth 5.0 and 5.2
- Geeks Disappointed that RTX 4080/4090 doesn’t come with PCIe 5.0
- What are advantages and disadvantages of different load balancing?
Meta Introduces ‘Transparent Memory Offload’ Feature to Save Massive Memory on Linux Servers.
Engineers at Meta (formerly Facebook) blogged about a new Linux kernel feature called ” Transparent memory offloading “, which they say can save 20% to 32% of memory per Linux server.
Transparent Memory Offload (TMO), Meta‘s solution for heterogeneous data center environments, introduces a new Linux kernel mechanism to measure work lost due to CPU, memory, and I/O resource shortages in real-time.
Guided by this information, TMO automatically adjusts the amount of memory to offload to heterogeneous devices, such as compressed memory or SSDs.
It does this based on the device’s performance characteristics and the app’s susceptibility to slower memory accesses.
The memory savings of TMO can be broken down into application, data center memory tax, and application memory tax.
The graph below shows the relative memory savings achieved by TMO for eight representative applications using different offload backends (compressed memory or SSD).
The blog post emphasizes that the TMO function has been proven for a long time, has high stability, and is very efficient in memory optimization for Linux servers:
TMO has been running in Meta’s production environment for over a year, saving 20% to 32% of total memory across millions of Linux servers in a massive data center fleet .
We have successfully uploaded TMO’s operating system components into the Linux kernel.
Interested friends can check the Meta blog for more technical information about Meta Transparent Memory Offload (TMO).
- DIY a PBX (Phone System) on Raspberry Pi
- How to host multiple websites on Raspberry Pi 3/4?
- A Free Intercom/Paging system with Raspberry pi and old Android phones
- DIY project: How to use Raspberry Pi to build DNS server?
- Raspberry Pi project : How to use Raspberry Pi to build git server?