AI Models
LID Lite 608
LID family · open weights on Hugging Face.
fastText language identification across Nigerian languages (Yorùbá, Igbo, Hausa, Pidgin, English).
FasttextLanguage IdentificationAfrican LanguagesText ClassificationAbkAbqAbsAceAcmAdyAebAfrAguAgxAiiAjgAkbAlnAlsAltAmhAmiAngAnnAnpApcArbArgArnArsAryArzAsmAstAtbAtjAvaAvkAwaAyrAzbAzjBakBamBanBarBasBbcBciBclBelBemBenBewBhoBisBjnBlkBnoBoaBodBosBpsBpyBqpBreBrhBruBrxBtsBtxBugBulBusBxrBzjCabCakCatCbiCbkCbuCebCesCfmChaCheChkChuChvCjkCjsCkbCktCmnCmoCnhCniCopCorCosCrhCrkCrsCsbCswCsyCtdCtuCukCymCztDagDakDanDarDeuDgaDhvDikDiqDivDjeDngDoiDopDsbDtpDyuDzoEkkEllEmlEmpEngEnmEnqEpoEsuEusEveEweEwoExtFaoFatFfmFijFilFinFitFkvFonFraFroFrpFrrFryFufFuhFurFuvGagGazGcfGcrGilGlaGleGlgGlkGlvGmhGohGomGorGosGotGrcGswGubGucGugGujGuwGuzGvnHacHaeHakHatHauHawHboHebHegHerHifHilHinHmoHmrHneHnjHrvHrxHsbHuiHunHuuHyeHywIbaIboIdoIkeIktIleIloInaIndInhIslItaIumJamJavJboJpnJraJvnKaaKabKacKalKamKanKasKatKazKbdKbpKbqKcaKckKdeKeaKekKgpKhaKhkKhmKikKinKirKiuKjhKmrKncKngKoiKorKosKpgKpvKrcKriKrjKrlKsdKshKswKtuKuaKumKwnKycKzjLadLaoLatLbeLewLexLezLfnLhuLijLimLinLitLivLldLmoLozLtgLtzLuaLubLugLuoLusLuzLvsLzhMadMagMahMaiMakMalMarMasMazMbbMcfMdfMeoMerMeuMfeMghMhrMicMinMiqMjwMkdMknMltMnaMniMnkMnwMohMosMpsMriMrjMrwMuiMwlMwwMxvMyaMyvMznNahNanNapNaqNavNblNbuNchNcjNdeNdoNdsNewNiaNijNiuNjoNldNlgNmfNnoNobNogNonNotNovNpiNqoNrfNrmNsoNusNyaNynNziOciOloOrvOryOssOtaOteOtwPagPamPanPapPauPbbPbtPcdPckNigerian PidginPdtPesPflPisPltPmsPnbPntPolPonPorPovPrgPwnQubQucQuhQupQuyQuzRadRarRawRcfRmcRmlRmnRmyRohRonRopRtmRueRugRunRupRusSagSahSanSatScnScoSdcSdhSgcSgsShiShnShpSidSinSkrSlkSlvSmaSmeSmjSmkSmlSmnSmoSmsSnaSndSomSotSpaSrdSrnSrpSrrSswStqSukSunSusSwcSweSwgSwhSycSzlSzyTabTahTamTaqTatTayTbgTcyTczTelTeoTetTgkThaThlTirTivTklTkrTlhTlyTobTodToiTojTokTonTpiTrcTrpTrvTsgTsnTsoTszTukTumTurTvlTwiTyvTzhTzmTzoUdmUigUkrUrdUznUzsVapVecVenVepVidVieVlsVmwVolVroWarWedWlnWlsWolWuuXalXavXhoXmfXmvYalYapYddYorYrkYuaYueZaiZdjZeaZghZhaZomZsmZulZybLicence: apache-2.0
0
Likes
0
Downloads
Oct 2026
Created
/ Model card
Built for production use
Open-weights repository on Hugging Face
Integrated ecosystem protocol tier.
Compatible with Transformers library
Integrated ecosystem protocol tier.
Optimised for low-latency inference
Integrated ecosystem protocol tier.
Community engagement: 0 likes
Integrated ecosystem protocol tier.
/ Quick start
Use LID Lite 608, straight from its model card.
example.pyfrom the model card
import json, math, fasttext
from huggingface_hub import hf_hub_download
repo = "olaverse/lid-lite-608"
model = fasttext.load_model(hf_hub_download(repo, "model.ftz"))
calib = json.load(open(hf_hub_download(repo, "priors.json")))
traffic_bias = {l: calib["alpha"] * v for l, v in calib["log_prior_ratio"].items()}
def identify(text, mode="coverage"):
text = " ".join(text.split()) # fastText needs a single line
k = 40 if mode == "traffic" else 1
labels, probs = model.predict([text], k=k) # list input: works with NumPy 1 and 2
labels, probs = labels[0], probs[0]
scores = {l[9:]: math.log(max(p, 1e-12)) + (traffic_bias.get(l[9:], 0.0) if mode == "traffic" else 0.0)
for l, p in zip(labels, probs)}
return max(scores, key=scores.get)
identify("Ẹ kú àárọ̀, ṣé dáadáa ni?") # 'yor_Latn'
identify("Habari za asubuhi") # 'swh_Latn'
identify("Bonjour mon ami", mode="traffic") # 'fra_Latn'
/ Model card
Official repository README
Dynamically loaded from Hugging Face
Model card metadata is available on Hugging Face.
/ Built with
Transformers PyTorch Python
Ready to try LID Lite 608?
fastText language identification across Nigerian languages (Yorùbá, Igbo, Hausa, Pidgin, English).
/ Model ecosystem