NUS
 
ISS
 

Custom Generative AI Systems for Enterprises

Overview

Reference No TGS-2024051032
Part of -
Duration 5 days
Course Time
Enquiry Please email ask-iss@nus.edu.sg for more details

This course provides a comprehensive blend of theoretical knowledge and practical skills necessary for designing, optimizing, and implementing custom generative AI systems in enterprise environments. Participants will acquire highly sought-after expertise, enhancing their marketability in the AI job market. By developing in-house capabilities, enterprises can minimize dependence on external providers (AWS, GCP) and ensure their AI deployments are efficient, scalable, and ethically sound, particularly in utilizing Large Language Models.

Upcoming Classes

Class 1: 19 to 23 May 2025 - Class Full
Duration: 5 Days
When: May 19, 20, 21, 22, 23
Mode of Conduct: Face-to-Face
Time: 9:00am to 5:30pm

Class 2: 14 to 18 Jul 2025
Duration: 5 Days
When: Jul 14, 15, 16, 17, 18
Mode of Conduct: Face-to-Face
Time: 9:00am to 5:30pm

Class 3: 8 to 12 Sep 2025
Duration: 5 Days
When: Sep 8, 9, 10, 11, 12
Mode of Conduct: Face-to-Face
Time: 9:00am to 5:30pm

Register

Registration Instructions

Self-sponsored Participants

  • Register for the course by clicking on the "Register Now" button above
  • You may refer to the User Guide for Learner

Company-sponsored Participants

  • You will have to be registered for the course by someone from your company who has an account on the LifeLong Learning Portal (L³AP)
  • The person in-charge may register you for the course by:
    • Generating a corporate registration link for you to register for the course
      • After the link is generated, you must:
        1. Log in to L³AP by clicking on the "Register Now" button
        2. Click on the corporate registration link after logging in
      • If you do not follow the above instructions, you will be registered for the course as self-sponsored
    • Registering you for the course backend
      • You will still be required to log in to L³AP and complete your registration by clicking on the "Register Now" button above
  • You may refer your HR/L&D POC to the User Guide for Company

Key Takeaways

  • Foundational Concepts: Understand the core principles of transformers architecture, their evolution, and their application in building enterprise AI systems.
  • Generative AI Frameworks: Learn and apply strategies for building enterprise AI applications using generative AI software frameworks (e.g., langchain, llamaindex). Fine-tune pre-trained models with available foundational models for specific enterprise tasks, including zero-shot learning on computer vision and retrieval-augmented generation.
  • Performance Optimization: Explore methods to enhance enterprise AI applications using reward-based reinforcement learning for performance optimization.
  • Deployment Strategies: Navigate challenges and strategies for deploying enterprise AI systems in production environments. Optimize models for efficient training and inference, with an understanding of model and data parallelism.
  • Practical Application: Apply theoretical knowledge through practical labs, building and deploying enterprise AI applications in real-world scenarios.

Our course participants will learn to first fine-tune real world enterprise applications with LLMs using foundational models from the closed source ones such as GPT 4o from Open AI and Claude 3.5 from Anthropic and open source ones such as lLAMA 3 from Meta or Hugging Faces and proceed to build their own LLMs if the foundational models are not able to fulfil the need.

Participants will benefit from a careful balance of lectures and practical workshops. There will be projects and assessment to reinforce participants’ learning as part of the course.



Who Should Attend

This course is suitable for information technology professionals who are planning to build their own enterprise AI applications with either with their own LLMs or fine-tune LLMs with foundational models.

This course will be useful for CTOs and technical leaders, data engineers, data scientists ML engineers, and software developers advancing in Large Language Models (LLMs) for fine-tuning, deployment, and training.

Pre-requisites

This is an intensive intermediate course.
• Participants should have intermediate mathematics and statistics knowledge, e.g. calculating boolean algebra (logic), and probability.
• Participants should have intermediate computer literacy and software engineering fundamentals, e.g. using Windows or Linux or MacOS, Microsoft Office or LibreOffice, VMware or VirtualBox, and aware of web application, and client-server software architecture.
• Participants should have current or prior hands-on coding experience in one or more high-level computer programming languages, preferable in Java. Experiences with Python, R, or structured query language (SQL) would have added advantages.
• Participants without programming experience should self-study basic Java or Python.
• Knowledge of deploying applications on the cloud such as AWS and GCP are a plus.  




What Will be Covered

  • Introduction to Large Language Models (LLMs)
  • LLM Pre-Training and Scaling Laws
  • Building with a Foundational Model with Langchain
  • Fine-tuning LLMs with Instruction
  • Parametric Effective Fine-Tuning (PEFT)
  • Fine-tuning a Generative AI model for dialogue summarization – Lab Hands On
  • Reinforcement Learning in LLMs with Human Feedback, Reward Hacking and Scaling
  • Applying Reinforcement Learning into LLM – Lab Hands On
  • Building your own LLM and choice of architecture
  • Planning the LLM Model pre-training
  • Gathering, Selection & Pre-processing dataset for LLM
  • Tokenization
  • Hyper-parameter tuning
  • Evaluation & Finetuning of Pre-trained LLMs
  • Scaling of LLMs
  • Retrieval Augmented Generation (RAG) Implementations
  • Responsible AI, LLMs reasoning and plan with chain of thought
  • In-class Project review



Fees & Subsidies

 



loading

Certificate

The ISS Certificate of Completion will be issued to participants who have attended at least 75% of the course and pass the required assessments.



Preparing for Your Course

NUS-ISS Course Registration Terms and Conditions

Find out more.

NUS-ISS and Learner’s Commitment and Responsibilities

Find out more.

WIFI Access

WIFI access will be made available to participants.

Venue

NUS-ISS
25 Heng Mui Keng Terrace
Singapore 119615

Click HERE for directions to NUS-ISS

In the event of a change of venue, participants are advised to refer to the acceptance email sent one week prior to the commencement date.

Course Confirmation

All classes are subject to confirmation and NUS-ISS will send an acceptance email to participants one week prior to the commencement date. Confirmed registrants are to attend and complete all lectures, class exercises, workshops and assessments (where applicable). Additionally, all responses to feedbacks and surveys conducted by NUS-ISS and its partners must be submitted. All training and assessments will be delivered as described in the course webpage.

General Enquiry

Please feel free to write to ask-iss@nus.edu.sg if you have any enquiry or feedback.




Course Resources

Develop your Career in the Following
Training Roadmap(s)

Please click on the discipline(s) to view the training roadmap of related courses to assess your training needs and goals.

Artificial Intelligence

Advance your business by harnessing artificial intelligence (AI) and deep machine learning

Read More Artificial Intelligence

You Might be Interested in...

A+
A-
Scrolltop
More than one Google Analytics scripts are registered. Please verify your pages and templates.