{"id":1293566,"date":"2025-04-14T08:09:20","date_gmt":"2025-04-14T02:39:20","guid":{"rendered":"https:\/\/trak.in\/stories\/?p=1293566"},"modified":"2025-04-14T08:12:55","modified_gmt":"2025-04-14T02:42:55","slug":"indian-ai-startups-system-can-run-ai-without-advanced-processors","status":"publish","type":"post","link":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/","title":{"rendered":"Indian AI Startup’s System Can Run AI Without Advanced Processors"},"content":{"rendered":"\n

In a major breakthrough for AI accessibility, Ziroh Labs<\/strong>, an Indian startup, has partnered with IIT Madras<\/strong> to create a new framework that allows large AI models to run efficiently on regular CPUs \u2014 eliminating the dependency on expensive and scarce GPUs.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The Birth of Kompact AI<\/h3>\n\n\n\n

The framework, called Kompact AI<\/strong>, was designed to democratize artificial intelligence by enabling powerful inference<\/a> (the stage where AI models are used after training) without requiring high-end computing chips like those from Nvidia. Instead, it runs on widely available CPUs<\/strong> such as Intel Xeon \u2014 significantly reducing costs.<\/p>\n\n\n\n

Ziroh Labs showcased its system running sophisticated models like Meta\u2019s Llama 2<\/strong> and Alibaba\u2019s Qwen2.5<\/strong> on a regular laptop. The company claims that their optimization delivers high-quality results<\/strong> without performance compromise.<\/p>\n\n\n\n

A Game-Changer for AI Affordability<\/h3>\n\n\n\n

India and many other countries face a bottleneck in AI development due to limited access to top-tier GPUs<\/strong>, which are not only expensive but also in short supply. This has created an \u201cAI divide,\u201d where only a handful of companies can afford to train and deploy advanced models.<\/p>\n\n\n\n

As V. Kamakoti<\/strong>, Director of IIT Madras, put it:<\/p>\n\n\n\n

\n

\u201cWe\u2019re demonstrating that you don\u2019t need a revolver to kill a mosquito.\u201d<\/p>\n<\/blockquote>\n\n\n\n

Global Validation & Impact<\/h3>\n\n\n\n

Ziroh Labs\u2019 approach isn\u2019t just a local success \u2014 it\u2019s been tested by global chipmakers like Intel Corp.<\/strong> and AMD<\/strong>, and is already drawing international attention. William Raduchel<\/strong>, ex-CSO at Sun Microsystems and a tech advisor to Ziroh Labs, called the innovation \u201cprofound,\u201d predicting significant market impact in the years to come.<\/p>\n\n\n\n

What This Means for AI Development<\/h3>\n\n\n\n

The Kompact AI framework comes at a time when startups and developers are exploring cost-efficient alternatives<\/strong> to scale AI. Inspired by efforts like China\u2019s DeepSeek, Ziroh Labs joins a growing movement to do more with less \u2014 enabling a more inclusive AI ecosystem<\/strong>.<\/p>\n\n\n\n

With Kompact AI, the future of large language models may no longer be confined to GPU-rich labs \u2014 but in the hands of anyone with a good laptop and a bold idea.<\/p>\n\n\n\n

Image Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

In a major breakthrough for AI accessibility, Ziroh Labs, an Indian startup, has partnered with IIT Madras to create a new framework that allows large AI models to run efficiently on regular CPUs \u2014 eliminating the dependency on expensive and scarce GPUs. The Birth of Kompact AI The framework, called Kompact AI, was designed to […]<\/p>\n","protected":false},"author":30,"featured_media":1293586,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[22],"tags":[271,381,7580],"class_list":["post-1293566","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-ai","tag-india","tag-konpact-ai"],"acf":[],"yoast_head":"\nIndian AI Startup's System Can Run AI Without Advanced Processors - Trak.in - Indian Business of Tech, Mobile & Startups<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Indian AI Startup's System Can Run AI Without Advanced Processors - Trak.in - Indian Business of Tech, Mobile & Startups\" \/>\n<meta property=\"og:description\" content=\"In a major breakthrough for AI accessibility, Ziroh Labs, an Indian startup, has partnered with IIT Madras to create a new framework that allows large AI models to run efficiently on regular CPUs \u2014 eliminating the dependency on expensive and scarce GPUs. The Birth of Kompact AI The framework, called Kompact AI, was designed to […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/\" \/>\n<meta property=\"og:site_name\" content=\"Trak.in - Indian Business of Tech, Mobile & Startups\" \/>\n<meta property=\"article:published_time\" content=\"2025-04-14T02:39:20+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-14T02:42:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM-1024x562.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"562\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Mohul Ghosh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mohul Ghosh\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/\",\"url\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/\",\"name\":\"Indian AI Startup's System Can Run AI Without Advanced Processors - Trak.in - Indian Business of Tech, Mobile & Startups\",\"isPartOf\":{\"@id\":\"https:\/\/trak.in\/stories\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png\",\"datePublished\":\"2025-04-14T02:39:20+00:00\",\"dateModified\":\"2025-04-14T02:42:55+00:00\",\"author\":{\"@id\":\"https:\/\/trak.in\/stories\/#\/schema\/person\/5092a7d2906e3f3c819643435477c2a7\"},\"breadcrumb\":{\"@id\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#primaryimage\",\"url\":\"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png\",\"contentUrl\":\"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png\",\"width\":2332,\"height\":1280},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/trak.in\/stories\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Indian AI Startup’s System Can Run AI Without Advanced Processors\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/trak.in\/stories\/#website\",\"url\":\"https:\/\/trak.in\/stories\/\",\"name\":\"Trak.in - Indian Business of Tech, Mobile & Startups\",\"description\":\"Trak.in is a popular Indian Business, Technology, Mobile & Startup blog featuring trending News, views and analytical take on Technology, Business, Finance, Telecom, Mobile, startups & Social Media Space\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/trak.in\/stories\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/trak.in\/stories\/#\/schema\/person\/5092a7d2906e3f3c819643435477c2a7\",\"name\":\"Mohul Ghosh\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/trak.in\/stories\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/66c129d83dd3f325a3b550eb1aa16891173ddfc4686361424206cd9a01311c89?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/66c129d83dd3f325a3b550eb1aa16891173ddfc4686361424206cd9a01311c89?s=96&d=mm&r=g\",\"caption\":\"Mohul Ghosh\"},\"url\":\"https:\/\/trak.in\/stories\/author\/mohul-ghosh\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Indian AI Startup's System Can Run AI Without Advanced Processors - Trak.in - Indian Business of Tech, Mobile & Startups","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/","og_locale":"en_US","og_type":"article","og_title":"Indian AI Startup's System Can Run AI Without Advanced Processors - Trak.in - Indian Business of Tech, Mobile & Startups","og_description":"In a major breakthrough for AI accessibility, Ziroh Labs, an Indian startup, has partnered with IIT Madras to create a new framework that allows large AI models to run efficiently on regular CPUs \u2014 eliminating the dependency on expensive and scarce GPUs. The Birth of Kompact AI The framework, called Kompact AI, was designed to […]","og_url":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/","og_site_name":"Trak.in - Indian Business of Tech, Mobile & Startups","article_published_time":"2025-04-14T02:39:20+00:00","article_modified_time":"2025-04-14T02:42:55+00:00","og_image":[{"width":1024,"height":562,"url":"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM-1024x562.png","type":"image\/png"}],"author":"Mohul Ghosh","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Mohul Ghosh","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/","url":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/","name":"Indian AI Startup's System Can Run AI Without Advanced Processors - Trak.in - Indian Business of Tech, Mobile & Startups","isPartOf":{"@id":"https:\/\/trak.in\/stories\/#website"},"primaryImageOfPage":{"@id":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#primaryimage"},"image":{"@id":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#primaryimage"},"thumbnailUrl":"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png","datePublished":"2025-04-14T02:39:20+00:00","dateModified":"2025-04-14T02:42:55+00:00","author":{"@id":"https:\/\/trak.in\/stories\/#\/schema\/person\/5092a7d2906e3f3c819643435477c2a7"},"breadcrumb":{"@id":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#primaryimage","url":"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png","contentUrl":"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png","width":2332,"height":1280},{"@type":"BreadcrumbList","@id":"https:\/\/trak.in\/stories\/indian-ai-startups-system-can-run-ai-without-advanced-processors\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/trak.in\/stories\/"},{"@type":"ListItem","position":2,"name":"Indian AI Startup’s System Can Run AI Without Advanced Processors"}]},{"@type":"WebSite","@id":"https:\/\/trak.in\/stories\/#website","url":"https:\/\/trak.in\/stories\/","name":"Trak.in - Indian Business of Tech, Mobile & Startups","description":"Trak.in is a popular Indian Business, Technology, Mobile & Startup blog featuring trending News, views and analytical take on Technology, Business, Finance, Telecom, Mobile, startups & Social Media Space","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/trak.in\/stories\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/trak.in\/stories\/#\/schema\/person\/5092a7d2906e3f3c819643435477c2a7","name":"Mohul Ghosh","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/trak.in\/stories\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/66c129d83dd3f325a3b550eb1aa16891173ddfc4686361424206cd9a01311c89?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/66c129d83dd3f325a3b550eb1aa16891173ddfc4686361424206cd9a01311c89?s=96&d=mm&r=g","caption":"Mohul Ghosh"},"url":"https:\/\/trak.in\/stories\/author\/mohul-ghosh\/"}]}},"jetpack_featured_media_url":"https:\/\/trak.in\/stories\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-14-at-8.08.17\u202fAM.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/posts\/1293566","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/comments?post=1293566"}],"version-history":[{"count":2,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/posts\/1293566\/revisions"}],"predecessor-version":[{"id":1293589,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/posts\/1293566\/revisions\/1293589"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/media\/1293586"}],"wp:attachment":[{"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/media?parent=1293566"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/categories?post=1293566"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/trak.in\/stories\/wp-json\/wp\/v2\/tags?post=1293566"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}