Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
nctu6
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
llama-cpp-python
llama_cpp
llama_chat_format.py
on
main
User selector
All users
All time
Commit history
Commits on Aug 30, 2024
fix: Use system message in og qwen format. Closes #1697
abetlen
committed
98eb092
View commit details
Copy full SHA for 98eb092
View code at this point
Browse repository at this point
Commits on Aug 29, 2024
fix: Update name to MiniCPMv26ChatHandler
abetlen
committed
e251a0b
View commit details
Copy full SHA for e251a0b
View code at this point
Browse repository at this point
feat: Add MiniCPMv26 chat handler.
abetlen
committed
f70df82
View commit details
Copy full SHA for f70df82
View code at this point
Browse repository at this point
Commits on Jul 9, 2024
fix(minor): Minor ruff fixes
abetlen
committed
08f2bb3
View commit details
Copy full SHA for 08f2bb3
View code at this point
Browse repository at this point
fix(misc): Format
abetlen
committed
c1ae815
View commit details
Copy full SHA for c1ae815
View code at this point
Browse repository at this point
Commits on Jun 4, 2024
fix: Avoid duplicate special tokens in chat formats (#1439)
Show description for 027f7bc
CISC
and
abetlen
authored
027f7bc
View commit details
Copy full SHA for 027f7bc
View code at this point
Browse repository at this point
Commits on Jun 3, 2024
misc: Improve llava error messages
abetlen
committed
6b018e0
View commit details
Copy full SHA for 6b018e0
View code at this point
Browse repository at this point
Commits on May 29, 2024
fix: Fix typo in Llama3VisionAlphaChatHandler. Closes #1488
abetlen
committed
165b4dc
View commit details
Copy full SHA for 165b4dc
View code at this point
Browse repository at this point
Commits on May 10, 2024
fix: Clear kv cache to avoid kv bug when image is evaluated first
abetlen
committed
ac55d0a
View commit details
Copy full SHA for ac55d0a
View code at this point
Browse repository at this point
fix(security): Render all jinja templates in immutable sandbox (#1441)
Show description for 561e880
CISC
and
abetlen
authored
561e880
View commit details
Copy full SHA for 561e880
View code at this point
Browse repository at this point
Merge pull request from GHSA-56xg-wfcc-g829
Show description for b454f40
retr0reg
and
abetlen
authored
b454f40
View commit details
Copy full SHA for b454f40
View code at this point
Browse repository at this point
Commits on May 9, 2024
fix: free last image embed in llava chat handler
abetlen
committed
3757328
View commit details
Copy full SHA for 3757328
View code at this point
Browse repository at this point
Commits on May 8, 2024
fix: Make leading bos_token optional for image chat formats, fix nanollava system message
abetlen
committed
7712263
View commit details
Copy full SHA for 7712263
View code at this point
Browse repository at this point
fix: adding missing args in create_completion for functionary chat handler (#1430)
skalade
authored
903b28a
View commit details
Copy full SHA for 903b28a
View code at this point
Browse repository at this point
Commits on May 4, 2024
feat: Implement streaming for Functionary v2 + Bug fixes (#1419)
Show description for 1f56c64
jeffrey-fong
and
abetlen
authored
1f56c64
View commit details
Copy full SHA for 1f56c64
View code at this point
Browse repository at this point
Commits on May 2, 2024
feat: Add llama-3-vision-alpha chat format
abetlen
committed
31b1d95
View commit details
Copy full SHA for 31b1d95
View code at this point
Browse repository at this point
Commits on Apr 30, 2024
fix: Change default verbose value of verbose in image chat format handlers to True to match Llama
abetlen
committed
4f01c45
View commit details
Copy full SHA for 4f01c45
View code at this point
Browse repository at this point
fix: Ensure image renders before text in chat formats regardless of message content order.
abetlen
committed
3489ef0
View commit details
Copy full SHA for 3489ef0
View code at this point
Browse repository at this point
feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)
Show description for fe2da09
abetlen
authored
fe2da09
View commit details
Copy full SHA for fe2da09
View code at this point
Browse repository at this point
Commits on Apr 28, 2024
fix: Functionary bug fixes (#1385)
Show description for f178636
jeffrey-fong
and
abetlen
authored
f178636
View commit details
Copy full SHA for f178636
View code at this point
Browse repository at this point
Commits on Apr 23, 2024
feat: Add Llama-3 chat format (#1371)
Show description for 8559e8c
andreabak
and
abetlen
authored
8559e8c
View commit details
Copy full SHA for 8559e8c
View code at this point
Browse repository at this point
Commits on Apr 20, 2024
feat: Add stopping_criteria to ChatFormatter, allow stopping on arbitrary token ids, fixes llama3 instruct
abetlen
committed
cc81afe
View commit details
Copy full SHA for cc81afe
View code at this point
Browse repository at this point
Commits on Apr 18, 2024
feat: update grammar schema converter to match llama.cpp (#1353)
Show description for 4f42664
themrzmaster
authored
4f42664
View commit details
Copy full SHA for 4f42664
View code at this point
Browse repository at this point
Commits on Apr 17, 2024
Revert "feat: Update json to grammar (#1350)"
Show description for fa4bb0c
abetlen
committed
fa4bb0c
View commit details
Copy full SHA for fa4bb0c
View code at this point
Browse repository at this point
feat: Update json to grammar (#1350)
Show description for 610a592
themrzmaster
authored
610a592
View commit details
Copy full SHA for 610a592
View code at this point
Browse repository at this point
Commits on Apr 10, 2024
fix: pass correct type to chat handlers for chat completion logprobs
abetlen
committed
bb65b4d
View commit details
Copy full SHA for bb65b4d
View code at this point
Browse repository at this point
Commits on Apr 5, 2024
fix: missing logprobs in response, incorrect response type for functionary, minor type issues. Closes #1328 Closes #1314
abetlen
committed
1ae3abb
View commit details
Copy full SHA for 1ae3abb
View code at this point
Browse repository at this point
Commits on Mar 31, 2024
feat: Add logprobs support to chat completions (#1311)
Show description for aa9f1ae
windspirit95
and
abetlen
authored
aa9f1ae
View commit details
Copy full SHA for aa9f1ae
View code at this point
Browse repository at this point
Commits on Mar 23, 2024
fix: tool_call missing first token.
abetlen
committed
c1325dc
View commit details
Copy full SHA for c1325dc
View code at this point
Browse repository at this point
Commits on Mar 19, 2024
feat: Add tools/functions variables to Jinja2ChatFormatter, add function response formatting for all simple chat formats (#1273)
Show description for 60d8498
abetlen
and
CISC
authored
60d8498
View commit details
Copy full SHA for 60d8498
View code at this point
Browse repository at this point
Commits on Mar 18, 2024
fix: Fix and optimize functionary chat handler (#1282)
Show description for 8a60c7b
jeffrey-fong
and
abetlen
authored
8a60c7b
View commit details
Copy full SHA for 8a60c7b
View code at this point
Browse repository at this point
Commits on Mar 15, 2024
fix: json mode
abetlen
committed
20e6815
View commit details
Copy full SHA for 20e6815
View code at this point
Browse repository at this point
Commits on Mar 9, 2024
fix: Check for existence of clip model path (#1264)
kejcao
authored
1f3156d
View commit details
Copy full SHA for 1f3156d
View code at this point
Browse repository at this point
Commits on Feb 26, 2024
fix: positional arguments only for low-level api
abetlen
committed
dbaba30
View commit details
Copy full SHA for dbaba30
View code at this point
Browse repository at this point
fix: typo
abetlen
committed
78e536d
View commit details
Copy full SHA for 78e536d
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.