Llama3 Laboratory @ MediaTek In this lab, we explaind the essential design choices used by llama3, including RMSNorm, Rotrary Embedding, and KV cache. RAG @ CGU We demonstrate the example usage of LangChain. Also in the labatory section, students are assigned to improve the embedding model. BERT @ CGU We explore the origins of BERT: why it was developed and how it revolutionized natural language processing. Followed by a hands-on workshop where students will build their own sentiment analysis model using BERT and PyTorch fundamentals.
