BLOG

If you're an ML engineer or a technical lead planning to pre-train a large language model (LLM) for Tagalog or Taglish, how do you start? In this article, we walk through the process of defining a target voice, building a data pipeline, running a QLoRA training experiment, and evaluating results with native speakers, so a team can test the idea with a small, well-scoped proof of concept before committing to a larger build.  Why natural Tagalog is harder than correct Tagalog for LLM A general-purpose LLM may produce Tagalog that is grammatically acceptable yet still sound overly formal, translated, or [...]

  As countries all around the world are beginning to invest in their own large language models, the same question keeps coming up in Philippine tech circles: should the country build one, too? If we do, would it be cost-effective? And if it is, would it be beneficial? As an early-career professional, I have heard these questions before, whether we are talking about sovereignty, independence, or simply having something to be proud of. Some people in our industry keep asking that question, and more often than not, in that same instance, the reality of creating one always surfaces. First, it [...]