Code Large Language Models (CS 4/510)
Ref. No: 43943 and 43944
Winter 2025
Course
Objective
§ Large language models have
many potential applications, not only to natural languages, but also to
computer languages. This course will focus on application of large language
models to computer code, for instance, in programming, compilation, static analysis,
testing, verification, profiling, documentation, etc. The course will cover
topics ranging from basics of large language models to advanced models specific
for code and to integration of these models in every facet of software
engineering processes. This study will be carried out by reading the most
recent papers from relevant conferences and journals.
Class
Homepage
§ http://www.cs.pdx.edu/~xie/cllms-w25/cllms-w25.htm
Instructor
§ Prof. Fei Xie
Office: FAB 120-10 Phone: (503) 725-2403
Homepage: http://www.cs.pdx.edu/~xie Email: xie@cs.pdx.edu
Office
Hours
Prerequisites:
§ None
Meeting
Time and Location
Textbooks
Grading
§ Paper Presentation and Class Participation:
50%
o Each
student is assigned to a team responsible for presenting two papers on a
specific topic in a given week and must participate in preparing and delivering
the presentations.
o Every
student is required to attend each meeting and participate in paper
discussions.
§ Paper
reviews: 50%
o Every student is required to submit 2-page review
for every paper being discussed each week, except the papers they are
presenting. A review is required to include:
§ Summary of the paper
§ Strength and Weakness of the paper/approach
§ Open problems from the paper
Class
Schedules
|
|
Dates
|
Topics |
Notes |
|
Week
1 |
Jan.
10 |
LLMs
Basics |
Group
1 |
|
Week
2 |
Jan.
17 |
Multimodal
LLMs |
Group
2 |
|
Week
3 |
Jan.
24 |
Software
Engineering Benchmarks for LLMs |
Group
3 |
|
Week
4 |
Jan.
31 |
Multimodal
LLMs for Front-End Development |
Group
4 |
|
Week
5 |
Feb.
7 |
LLMs as
Programming Agents |
Group 5 |
|
Week
6 |
Feb.
14 |
LLMs
Augmented with Tools |
Group 6 |
|
Week
7 |
Feb.
21 |
LLMs
for Testing |
Group
7 |
|
Week
8 |
Feb.
28 |
Reasoning
with LLMs |
Group
8 |
|
Week
9 |
Mar.
7 |
LLMs
for Theorem Proving |
Group
9 |
|
Week
10 |
Mar.
14 |
Security
and Trustworthiness of LLMs |
Group
10 |
(This
schedule is subject to changes according to the need of the class. For the
readings of each class meeting, please see the reading list.)
Academic
Integrity
§ Academic
misconducts will be handled according to the rules of the Department of
Computer Science, Maseeh College of Engineering and Computer Science, and