Publications
Conference and workshop papers
2025
-
A Stakeholder-Based Framework to Highlight Tensions when Implementing Privacy Features
Julia Netter, Tim Nelson, Skyler Austen, Eva Lau, Colton Rusch, Malte Schwarzkopf, Kathi Fisler
To appear at USENIX Security 2025
-
Paralegal: Practical Static Analysis for Privacy Bugs
Justus Adam, Carolyn Zech, Livia Zhu, Sreshtaa Rajesh, Nathan Harbison, Mithi Jethwa, Will Crichton, Shriram Krishnamurthi, Malte Schwarzkopf
To appear at OSDI 2025
-
Quicksand: Harnessing Stranded Datacenter Resources with Granular Computing
[usenix]
[code]
Zhenyuan Ruan, Shihang Li, Kaiyan Fan, Marcos K. Aguilera, Adam Belay, Seo Jin Park, Malte Schwarzkopf
NSDI 2025
-
VectraFlow: Integrating Vectors into Stream Processing
[CIDR]
Duo Lu, Siming Feng, Jonathan Zhou, Franco Solleza, Malte Schwarzkopf, Uğur Çetintemel
CIDR 2025
2024
-
Sesame: Practical End-to-End Privacy Compliance with Policy Containers and Privacy Regions
[ACM]
[code]
Kinan Dak Albab, Artem Agvanian, Allen Aby, Corinn Tiffany, Alexander Portland, Sarah Ridley, Malte Schwarzkopf
SOSP 2024
-
Mach: Firefighting Time-Critical Issues in Complex Systems Using High-Frequency Telemetry (Demo Paper)
[VLDB]
[code]
Franco Solleza, Shihang Li, William Sun, Richard Tang, Malte Schwarzkopf, Nesime Tatbul, Andrew Crotty, David Cohen, Stan Zdonik
VLDB 2024 (Demo Track)
2023
-
Edna: Disguising and Revealing User Data in Web Applications
[ACM]
[code]
Lillian Tsai, Hannah Gross, Eddie Kohler, Frans Kaashoek, Malte Schwarzkopf
SOSP 2023
-
K9db: Privacy-Compliant Storage For Web Applications By Construction
[usenix]
[code]
Kinan Dak Albab, Ishan Sharma, Justus Adam, Benjamin Kilimnik, Aaron Jeyaraj, Raj Paul, Artem Agvanian, Leonhard Spiegelberg, Malte Schwarzkopf
OSDI 2023
-
Towards Increased Datacenter Efficiency with Soft Memory
[SIGOPS]
[ACM]
Megan Frisella, Shirley Loayza Sanchez, Malte Schwarzkopf
HotOS 2023
-
Unleashing True Utility Computing with Quicksand
[SIGOPS]
[ACM]
Zhenyuan Ruan, Shihang Li, Kaiyan Fan, Marcos K. Aguilera, Adam Belay, Seo Jin Park, Malte Schwarzkopf
HotOS 2023
-
Nu: Achieving Microsecond-Scale Resource Fungibility with Logical Processes
[usenix]
[code]
Zhenyuan Ruan, Seo Jin Park, Marcos K. Aguilera, Adam Belay, Malte Schwarzkopf
NSDI 2023
2022
-
Retrofitting GDPR Compliance onto Legacy Databases
[VLDB]
Archita Agarwal, Marilyn George, Aaron Jeyaraj, Malte Schwarzkopf
VLDB 2022
2021
-
Privacy Heroes Need Data Disguises
[SIGOPS]
[ACM]
Lillian Tsai, Malte Schwarzkopf, Eddie Kohler
HotOS 2021 Best presentation runner-up
-
Tuplex: Data Science in Python at Native Code Speed
[ACM]
[web]
[code]
Leonhard F. Spiegelberg, Rahul Yesantharao, Malte Schwarzkopf, Tim Kraska
SIGMOD 2021
2020
-
AIFM: High-Performance, Application-Integrated Far Memory
[usenix]
[code]
Zhenyuan Ruan, Malte Schwarzkopf, Marcos Aguilera, Adam Belay
OSDI 2020
-
Shared Arrangements: practical inter-query sharing for streaming dataflows
[VLDB]
Frank McSherry, Andrea Lattuada, Malte Schwarzkopf, Timothy Roscoe
VLDB 2020
2019
-
Towards Safe Online Reinforcement Learning in Computer Systems
Hongzi Mao, Malte Schwarzkopf, Hao He, Mohammad Alizadeh
ML for Systems @ NeurIPS 2019
-
GDPR Compliance by Construction
Malte Schwarzkopf, Eddie Kohler, M. Frans Kaashoek, Robert Morris
Poly 2019
-
Learning Scheduling Algorithms for Data Processing Clusters
[ACM]
[website]
Hongzi Mao, Malte Schwarzkopf, Shaileshh Bojja Venkatakrishnan, Zili Meng, Mohammad Alizadeh
SIGCOMM 2019
-
Towards Multiverse Databases
[ACM]
Alana Marzoev, Lara Timbó Araújo, Malte Schwarzkopf, Samyukta Yagati, Eddie Kohler, Robert Morris, M. Frans Kaashoek, Sam Madden
HotOS 2019
-
Variance Reduction for Reinforcement Learning in Input-Driven Environments [arXiv:1807.02264] [videos]
Hongzi Mao, Shaileshh Bojja Venkatakrishnan, Malte Schwarzkopf, Mohammad Alizadeh
ICLR 2019
-
Conclave: secure multi-party computation on big data
[ACM] [extended TR (with proofs)] [code]
Nikolaj Volgushev, Malte Schwarzkopf, Ben Getchell, Andrei Lapets, Mayank Varia, Azer Bestavros
EuroSys 2019
2018
-
Noria: dynamic, partially-stateful data-flow for high-performance Web applications
[usenix]
Jon Gjengset*, Malte Schwarzkopf*, Jonathan Behrens, Lara Timbó Araújo, Martin Ek, Eddie Kohler, M. Frans Kaashoek, Robert Morris
OSDI 2018
-
Evaluating End-to-End Optimization for Data Analytics Applications in Weld
[VLDB]
Shoumik Palkar, James J. Thomas, Deepak Narayanan, Pratiksha Thaker, Rahul Palamuttam, Parimarjan Negi, Anil Shanbhag, Malte Schwarzkopf, Holger Pirk, Saman Amarasinghe, Samuel Madden, Matei Zaharia
VLDB 2018
2017
-
Weld: A Common Runtime for High Performance Data Analytics
[CIDR]
Shoumik Palkar, James J. Thomas, Anil Shanbhag, Deepak Narayanan, Holger Pirk, Malte Schwarzkopf, Saman Amarasinghe, Matei Zaharia
CIDR 2017
2016
-
Firmament: fast, centralized cluster scheduling at scale
[usenix] [website]
Ionel Gog, Malte Schwarzkopf, Adam Gleave, Robert N.M. Watson and Steven Hand
OSDI 2016
2015
-
Broom: sweeping out Garbage Collection from Big Data systems
[usenix]
Ionel Gog, Jana Giceva, Malte Schwarzkopf, Kapil Viswani, Dimitrios Vytiniotis, Ganesan Ramalingan, Manuel Costa, Derek Murray, Steven Hand and Michael Isard
HotOS 2015
-
Queues don't matter when you can JUMP them!
[usenix] [website]
Matthew P. Grosvenor, Malte Schwarzkopf, Ionel Gog, Andrew W. Moore, Robert N.M. Watson, Steven Hand and Jon Crowcroft
NSDI 2015 – Best paper award!
-
Musketeer: all for one, one for all in data processing systems
[ACM DL]
Ionel Gog, Malte Schwarzkopf, Natacha Crooks, Matthew P. Grosvenor, Allen Clement and Steven Hand
EuroSys 2015
2013
-
New wine in old skins: the case for distributed operating systems in the data center
[ACM DL] [slides]
Malte Schwarzkopf, Matthew P. Grosvenor and Steven Hand
APSYS 2013
-
Omega: flexible, scalable schedulers for large compute clusters
[ACM DL] [slides, slides (PDF)]
Malte Schwarzkopf, Andy Konwinski, Michael Abd-El-Malek and John Wilkes
EuroSys 2013 – Best student paper award! Test-of-Time Award (2023)
2012
-
The seven deadly sins of cloud computing research
[usenix] [slides]
Malte Schwarzkopf, Derek G. Murray and Steven Hand
HotCloud 2012
-
A down-to-earth look at the cloud host OS
[ACM DL] [slides]
Malte Schwarzkopf and Steven Hand
HotCDP 2012
-
The Case for Reconfigurable I/O Channels
Steven Smith, Anil Madhavapeddy, Christopher Smowton, Malte Schwarzkopf, Richard Mortier, Robert Watson and Steven Hand
RESoLVE 2012
2011
-
Condensing the cloud: running Ciel on many-core
[slides]
Malte Schwarzkopf, Derek G. Murray and Steven Hand
SFMA 2011
-
Ciel: a universal execution engine for distributed data-flow computing
[usenix]
Derek G. Murray, Malte Schwarzkopf, Christopher Smowton, Steven Smith, Anil Madhavapeddy and Steven Hand
NSDI 2011
-
Unclouded Vision (invited paper) [springer]
Jon Crowcroft, Anil Madhavapeddy, Malte Schwarzkopf, Theodore Hong and Richard Mortier
ICDCN 2011
2010
-
Unclouded Vision
Jon Crowcroft, Anil Madhavapeddy, Malte Schwarzkopf, Theodore Hong and Richard Mortier
Digital Futures 2010
-
Using Dust Clouds to Enhance Anonymous Communication
[slides]
Richard Mortier, Anil Madhavapeddy, Theodore Hong, Derek G. Murray and Malte Schwarzkopf
IWSP 2010
Theses/Dissertations
-
Operating system support for warehouse-scale computing
Malte Schwarzkopf
PhD dissertation, University of Cambridge Computer Laboratory.
Submitted: October 23, 2015.
Defended: February 12, 2016.
Approved: August 12, 2016.
» Dissertation (8 MB, PDF) -
Proteus – Interactive Annotation-Based 3D Structure-from-Motion
Malte Schwarzkopf
BA (Part II) Dissertation, Cambridge Computer Science Tripos, May 2009.
» Project website
» Dissertation (13 MB, PDF)
Journal and Magazine articles
-
Noria: A New Take on Fast Web Application Backends (invited submission) [usenix]
Jon Gjengset, Malte Schwarzkopf, Jonathan Behrens, Lara Timbó Araújo, Martin Ek, Eddie Kohler, M. Frans Kaashoek, Robert Morris
USENIX ;login: magazine, vol. 44, no. 1, Spring 2019.
-
Research for Practice: Cluster Scheduling for Datacenters (invited submission)
Malte Schwarzkopf, Peter Bailis (ed.)
ACM Queue, vol. 15, no. 5, September-October 2017. [online] [ACM DL]
Communications of the ACM, vol. 61, no. 5, May 2018. [online] [ACM DL] -
Non-volatile storage (invited submission)
Mihir Nanavati, Malte Schwarzkopf, Jake Wires and Andrew Warfield
ACM Queue, vol. 13, no. 9, November-December 2015. [ACM DL]
Communications of the ACM, vol. 59, no. 1, January 2016. [ACM DL] -
Jump the queue to lower latency (invited submission) [usenix]
Matthew P. Grosvenor, Malte Schwarzkopf, Ionel Gog and Andrew W. Moore
USENIX ;login: magazine, vol. 40, no. 2, April 2015.
-
Raft Refloated: Do We Have Consensus? [ACM DL]
Heidi Howard, Malte Schwarzkopf, Anil Madhavapeddy and Jon Crowcroft
ACM SIGOPS Operating Systems Review – Special Issue on Repeatability and Sharing of Experimental Artifacts 49.1 (January 2015).
-
Please mind the gap between intra- and inter-chassis parallelism!
[on the TinyToCS site]
Malte Schwarzkopf, Derek G. Murray and Steven Hand
In volume 1 of Tiny Transactions on Computer Science (TinyToCS)
Other material
As a side-effect of my research, I have produced various assets that people seem to find interesting:
- Overview diagrams and a bibliographies of the published components of Google and Facebook data center stacks (from the background chapter of my PhD dissertation).
- A talk and slide deck on the anatomy of a modern scalable infrastructure stack, drawing on examples of systems used at Google and Facebook.
Media coverage
My research occasionally gets covered outside academic circles and in the press. Here is a list of some things people have written. You can follow me on Twitter to find out about these occasions in real time!
- July 7, 2021: Tuplex on Datanami and CDOTrends.
- July 1, 2021: Tuplex on Brown News.
- June 17, 2019: the morning paper – covers multiverse databases.
- October 29, 2018: the morning paper – covers Noria.
- November 30, 2016: the morning paper – covers Firmament.
- December 7, 2015: "TNS Analysts: Talking OpenShift and Schedulers at KubeCon 2015" – mentions Firmament.
- September 2015: "Google's Data Architecture and What it Takes to Work at Scale" – covers my talk on scalable distributed systems stacks.
- May 12, 2015: the morning paper – covers QJump.
- April 27, 2015: the morning paper – covers Musketeer (part I, part II)