<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[SM Shahbaj]]></title><description><![CDATA[SM Shahbaj]]></description><link>https://smshahbaj.hashnode.dev</link><image><url>https://cdn.hashnode.com/res/hashnode/image/upload/v1593680282896/kNC7E8IR4.png</url><title>SM Shahbaj</title><link>https://smshahbaj.hashnode.dev</link></image><generator>RSS for Node</generator><lastBuildDate>Fri, 25 Sep 2026 09:53:13 GMT</lastBuildDate><atom:link href="https://smshahbaj.hashnode.dev/rss.xml" rel="self" type="application/rss+xml"/><language><![CDATA[en]]></language><ttl>60</ttl><item><title><![CDATA[Building RIFA: What It Takes to Make a Language Model That Actually Understands Bangla]]></title><description><![CDATA[Most language models treat Bangla as an afterthought. Train on a mostly-English corpus, throw in a slice of other languages for coverage, and call it "multilingual." The result: models that stumble on]]></description><link>https://smshahbaj.hashnode.dev/building-rifa-what-it-takes-to-make-a-language-model-that-actually-understands-bangla</link><guid isPermaLink="true">https://smshahbaj.hashnode.dev/building-rifa-what-it-takes-to-make-a-language-model-that-actually-understands-bangla</guid><category><![CDATA[RIFA]]></category><category><![CDATA[language models]]></category><category><![CDATA[slm]]></category><category><![CDATA[Bangla nlp]]></category><category><![CDATA[Open Source]]></category><category><![CDATA[SM Shahbaj]]></category><dc:creator><![CDATA[SM Shahbaj]]></dc:creator><pubDate>Sat, 19 Sep 2026 11:30:28 GMT</pubDate><content:encoded><![CDATA[<p>Most language models treat Bangla as an afterthought. Train on a mostly-English corpus, throw in a slice of other languages for coverage, and call it "multilingual." The result: models that stumble on Bangla grammar, mistranslate idioms, or just default back to English mid-conversation. And on top of that, most capable models are too heavy to run on anything but a rented GPU.</p>
<p>That combination — weak Bangla support and heavy hardware requirements — is the problem RIFA was built to solve.</p>
<p>Starting From a Different Question</p>
<p>Instead of asking "how do we make the biggest model possible," RIFA started from a narrower, more practical question: what's the smallest model that can still hold a real conversation in both English and Bangla, on hardware a normal developer actually owns?</p>
<p>That question shaped everything about how the project turned out. Rather than one flagship model, it became five — each one tuned for a different constraint, not a different market segment.</p>
<p>Five Models, Five Constraints</p>
<p>• Rifa-Nano (0.5B) exists for one reason: run anywhere. It's fine-tuned from Qwen2.5-0.5B-Instruct and carries dedicated anti-hallucination training, so instead of confidently making things up when it doesn't know an answer, it's more likely to say so. That matters more at 0.5B than almost any other design choice — a tiny model that's honest about its limits is far more usable than one that guesses convincingly.</p>
<p>• RIFA-CODE (0.6B) narrows the focus further, toward code completion and short scripts. It's not trying to compete with large code models — it's trying to be useful on a machine that couldn't run one anyway. RIFA-Edge (0.6B) is built around a single constraint: no GPU. CPU-first inference, tuned for edge and embedded deployment, where "efficient" isn't a nice-to-have, it's the whole point.</p>
<p>• RIFA-FLASH (1.7B) is the model most people should probably start with. It's the point in the series where quality starts to noticeably improve, while it's still light enough for real-time, interactive chat.</p>
<p>• RIFA-PRO (3B) is the top of the range — still small by industry standards, but the model to reach for when output quality matters more than shaving off the last bit of memory or latency.</p>
<p>Four Rules That Shaped the Project</p>
<p>Everything in RIFA was built against four constraints:</p>
<p>• Efficient — if it doesn't run on modest hardware, it doesn't belong in the series Capable — every model has to be genuinely useful for its size class, not just small for the sake of being small</p>
<p>• Yours — full open weights, Apache 2.0 licensed, documented well enough that someone else can pick it up and actually use it</p>
<p>• Honest — small models have real limits, and pretending otherwise helps no one</p>
<p>That last point is the one most projects skip. It's easier to market a small model as "surprisingly capable" than to say plainly: this is a 0.5B parameter model, it will get things wrong, verify anything that matters.</p>
<p>Running It Yourself</p>
<p>Every model ships two ways: full Safetensors weights for anyone working in Hugging Face Transformers, and GGUF quantizations for fully offline use in Ollama, LM Studio, or llama.cpp. If you're not sure where to start, Q5_K_M is the quantization that tends to balance quality and size best across the lineup.</p>
<p>Where the Line Actually Is</p>
<p>None of the RIFA models will out-reason a frontier-scale LLM, and they're not supposed to. Multi-step reasoning, obscure domains, very recent events — that's where the cracks show. The anti-hallucination training in Rifa-Nano helps it recognize when it's out of its depth, but it doesn't make the model know more than it does. Treat these as fast, private, offline-capable assistants for everyday tasks — not a research assistant for anything high-stakes.</p>
<p>Who's Behind It</p>
<p>RIFA is an independent project by SM Shahbaj, published on Hugging Face as smshahbaj — built out of the same everyday need it tries to solve: wanting a model that speaks Bangla properly and doesn't need a data center to run.</p>
<p>Links Collection: huggingface.co/collections/smshahbaj/rifa-text-series</p>
<p>Docs scripts: github.com/smshahbaj/RIFA-Text-Series</p>
<p>Rifa-Nano-0.5B: huggingface.co/smshahbaj/Rifa-Nano-0.5B</p>
<p>RIFA-CODE-0.6B: huggingface.co/smshahbaj/RIFA-CODE-0.6B</p>
<p>RIFA-Edge-0.6B: huggingface.co/smshahbaj/RIFA-Edge-0.6B</p>
<p>RIFA-FLASH-1.7B: huggingface.co/smshahbaj/RIFA-FLASH-1.7B</p>
<p>RIFA-PRO-3B: huggingface.co/smshahbaj/RIFA-PRO-3B</p>
<p>Paper: doi.org/10.6084/m9.figshare.33941830</p>
]]></content:encoded></item></channel></rss>