Eliminating Bottlenecks in Real-Time Data Streaming: A Zomato Ads Flink Journey


<h2 class="wp-block-heading"><strong>Introduction</strong></h2>



<p>At Zomato, we love food and we love data. And sometimes, those two passions collide in the creation of beautiful, portable, and secure PDFs. From invoices and receipts to detailed reports, PDFs are a cornerstone of our operations and a staple across the industry. However, our existing PDF generation process, powered by a PHP-based library, was starting to show its age. We encountered latency issues, especially during the peak hours and the situation worsened with complex, multi-page PDFs that included significant graphical content.</p>



<p>We needed a solution that could sustain our growing demands &#8211; something faster, more efficient, and scalable.</p>



<h2 class="wp-block-heading"><strong>The Perfect Blend: Chromium and Golang</strong></h2>



<p>In pursuit of a more tailored and efficient approach, we decided to develop our in-house PDF generation solution. We chose Go as our programming language, given its performance and our team&#8217;s familiarity with it.</p>



<p>For rendering, we leveraged <a href="https://github.com/go-rod/rod">Rod</a>, a go library for controlling headless Chromium. For PDF signing, we integrated Go PDF (<a href="https://github.com/digitorus/pdf">digitorus/pdf</a>), allowing us to generate and sign PDFs directly from HTML templates. This approach gave us full control over layout, styling, and security.</p>



<h2 class="wp-block-heading"><strong>Custom Certificate Signing</strong></h2>



<p>To ensure the authenticity and integrity of our PDFs, we implemented digital signing using a custom certificate. This adds a layer of security and trust to our documents, which is especially important for sensitive information like financial transactions.</p>



<h2 class="wp-block-heading"><strong>Optimizations: Squeezing Every Last Drop of Performance</strong></h2>



<p>We&#8217;re always looking for ways to improve performance, and Espresso is no exception. We implemented several optimizations to make our PDF generation process as fast and efficient as possible:</p>



<ul class="wp-block-list">
<li><strong>Pre-Paint PDF Generation:</strong> We generate the PDF before the paint step of the rendering process, saving valuable time.</li>



<li><strong>Chromium Flags:</strong> We fine-tuned various Chromium flags to further improve the start time of the application.</li>



<li><strong>DataURI Image Prefetching:</strong> We prefetch HTML images from the template and save them as dataURIs, reducing the rendering cost by eliminating the need for the browser to download images on page load.</li>



<li><strong>Streamlined Processing:</strong> By combining PDF generation and signing into a single application, we can work with streams instead of files, improving performance and reducing disk I/O.</li>
</ul>



<h2 class="wp-block-heading"><strong>Brewing PDFs for Everyone</strong></h2>



<p>We developed a small front-end application to accompany this system, allowing anyone at Zomato to create and customize PDF templates effortlessly. This tool empowers users to modify existing templates or design new ones from scratch, all while receiving real-time feedback on the appearance of their final PDF output.</p>


<div class="wp-block-image">
<figure class="aligncenter size-large"><img data-recalc-dims="1" loading="lazy" decoding="async" width="640" height="319" src="https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=640%2C319&#038;ssl=1" alt="" class="wp-image-14539" srcset="https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=1024%2C511&amp;ssl=1 1024w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=300%2C150&amp;ssl=1 300w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=768%2C383&amp;ssl=1 768w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=1536%2C767&amp;ssl=1 1536w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=2048%2C1022&amp;ssl=1 2048w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=1200%2C599&amp;ssl=1 1200w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?resize=1568%2C783&amp;ssl=1 1568w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?w=1280&amp;ssl=1 1280w, https://i0.wp.com/zomatoblog.com/wp-content/uploads/2025/03/Untitled-design-1.png?w=1920&amp;ssl=1 1920w" sizes="auto, (max-width: 640px) 100vw, 640px" /></figure></div>


<h2 class="wp-block-heading"><strong>Open Source: Sharing the Espresso Love</strong></h2>



<p>Driven by our commitment to open source, we’re excited to announce that Espresso is now available for everyone. You can deploy it in your environment, tailor it to your specific requirements, or even actively contribute to its ongoing development. This includes the lib package, which you can utilise as a library within your Go applications to build and customize your PDF generation solutions.</p>



<p>We hope that Espresso will serve as a powerful asset for organizations and developers seeking a rapid, efficient, and dependable PDF generation solution.</p>



<p>You can find the repository on github: <a href="https://github.com/zomato/espresso">https://github.com/zomato/espresso</a>. We&#8217;re offering Espresso and the packages with a very permissive MIT license, allowing developers to utilise it as per their requirements/needs while retaining full ownership of the data.</p>



<h2 class="wp-block-heading"><strong>Benchmarks: The Proof is in the Pudding</strong></h2>



<p>Espresso isn&#8217;t just fast &#8211; it&#8217;s incredibly fast. Espresso has been successfully deployed across the majority of our PDF generation workflows, delivering consistently impressive performance metrics.</p>



<ul class="wp-block-list">
<li><strong>Rendering and Signing Times Under 200ms:</strong> Espresso can render and sign PDFs in under 200 milliseconds, making it ideal for high-traffic applications.</li>



<li><strong>Peak Load Handling:</strong> Espresso can handle peak loads of 120K requests per minute (RPM), ensuring your users never have to wait for their PDFs.</li>



<li><strong>Massive Signing Capability:</strong> We recently signed 1.6 million PDFs in just 19 minutes &#8211; approximately 1,400 PDFs per second.</li>
</ul>



<p>These numbers were witnessed when running espresso as an AWS ECS service with 4vcpu and 4G memory. This scaled to a hundred containers at peak load.</p>



<p>Espresso&#8217;s efficiency is truly remarkable. Compared to our prior system, it demands significantly less infrastructure, drastically reducing resource consumption. This translates directly into substantial cost savings, resulting in a 90% deduction in server costs for generating the same volume of PDFs.</p>



<h2 class="wp-block-heading"><strong>Conclusion: The Perfect Cup of PDF</strong></h2>



<p>Espresso is the culmination of our quest for the perfect PDF generation solution. It delivers simplicity, speed, efficiency and unwavering reliability, all within an open-source framework. We&#8217;re proud of what we&#8217;ve built and are excited to share it with the world. So go ahead, grab a cup of your favorite beverage, and give Espresso a try. We think you&#8217;ll find it&#8217;s the perfect blend of speed, simplicity, and power.</p>



<p><strong>And remember, much like a perfectly brewed coffee, the most effective solutions are often discovered in the simplest of places.</strong></p>


Espresso: Brewing PDFs at Zomato, Faster Than You Can Say “Cappuccino”

Apache Flink Journey @Zomato: From Inception to Innovation


<p>For restaurants, the choice of POS system is critical. POS players differ in terms of feature availability, speed of building new features, tech stability and scalability. POS systems also play a crucial role in ensuring smooth order processing and operations management. They have evolved to become integrated platforms that handle inventory management, handle staff payroll, and real-time analytics across multiple channels &#8211; online aggregators, dining, and take-away.</p>



<p>Over the last several years, Zomato, in partnership with various POS players, has worked deeply to innovate on new features, helping restaurants transform the way they manage and optimize their operations. As the restaurant industry scales, there is a need to enable POS players, both new and existing, to be able to solve problems in a quick and efficient manner for more restaurants.</p>



<p>As a first step to achieve this goal, Zomato has launched a developer platform for POS partners, to ensure quick, reliable integrations that enhance restaurant operations. This platform will offer easy-to-read documentation, real-time API testing, and an entire tool-kit for POS developers, thereby enabling POS partners to introduce many more features at scale.</p>



<p><strong>Key features</strong></p>



<p>Zomato’s POS Developer Platform is built to streamline integration and make life easier for POS developers, with features that include:</p>



<ol class="wp-block-list">
<li><strong>Quick onboarding and integration</strong>: Developers can easily create an account and access easy-to-read integration guide; providing step-by-step instructions, reducing confusion and saving valuable development time.</li>



<li><strong>Unified API documentation</strong>: The platform brings all API technical documentation together in one place, making it simple for developers to find what they need.</li>



<li><strong>Real-time API testing</strong>: POS partners can test APIs and webhooks in real time, which speeds up the development process by allowing immediate troubleshooting.</li>
</ol>



<p>With Zomato’s new developer platform, POS partners can now roll out new features for restaurants quickly in significantly shorter development cycles, allowing restaurants to focus on what matters most: making awesome food and offering a great customer experience.</p>



<p>If you’re a POS partner looking to streamline your integration with Zomato, the new Developer Platform is ready for you. Sign up, and begin your integration process today by visiting the POS<a href="https://www.zomato.com/developer/integration/"> Developer Platform</a>. If you are a restaurant looking for a POS system, visit the <a href="https://www.zomato.com/restaurant-services-hub/pos/">Restaurant Services Hub</a> to make an informed choice.</p>



<p>For any queries or feedback, please write to us on <a href="mailto:posintegarations@zomato.com">posintegarations@zomato.com</a>.</p>
