Trelis Research Updates
Subscribe
Sign in
Home
Notes
Archive
About
Latest
Top
Full fine-tuning versus (Q)LoRA
Plus rank stabilized LoRA (rsLoRA) and LoRA Aware quanting (LoftQ)
Apr 16
•
Trelis Research
Share this post
Full fine-tuning versus (Q)LoRA
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Multi-GPU Fine-Tuning for LLMs
Distributed- and Fully Sharded Data Parallel (FSDP)
Apr 10
•
Trelis Research
Share this post
Multi-GPU Fine-Tuning for LLMs
blog.trelis.com
Copy link
Facebook
Email
Note
Other
March 2024
Combining Preference and Supervised Fine-tuning
with ORPO
Mar 28
•
Trelis Research
Share this post
Combining Preference and Supervised Fine-tuning
blog.trelis.com
Copy link
Facebook
Email
Note
Other
AI Essentials for Office Workers
New Course!
Mar 22
•
Trelis Research
Share this post
AI Essentials for Office Workers
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Deploying Serverless Endpoints
💫 Scaling LLM Inference with Serverless Endpoints on RunPod 💫 Serverless endpoints allow you to automatically scale the number of GPUs based on…
Mar 19
•
Trelis Research
Share this post
Deploying Serverless Endpoints
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Improved Retrieval Augmented Generation with ALL-SORT
and the best model to run on 1xA100 80GB
Mar 14
•
Trelis Research
Share this post
Improved Retrieval Augmented Generation with ALL-SORT
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Chinese, Spanish and Zero-shot Function Calling
and a one-click template for Gemma
Mar 6
•
Trelis Research
Share this post
Chinese, Spanish and Zero-shot Function Calling
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Fine tuning LLMs for Memorization
Dataset Generation and Fine-tuning
Mar 4
•
Trelis Research
Share this post
Fine tuning LLMs for Memorization
blog.trelis.com
Copy link
Facebook
Email
Note
Other
February 2024
Evaluating Mistral Large and Custom LLMs
Nicolas Carlini has released his benchmarking approach
Feb 28
•
Trelis Research
Share this post
Evaluating Mistral Large and Custom LLMs
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Fine-tuning Optimizations
LoRA+, DoRA, NEFT and Unsloth
Feb 26
•
Trelis Research
Share this post
Fine-tuning Optimizations
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Fine-tune Multi-modal Vision and Language Models
and a one-click API template for Mamba!
Feb 16
•
Trelis Research
3
Share this post
Fine-tune Multi-modal Vision and Language Models
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Understanding Mamba
State Space Models
Feb 2
•
Trelis Research
1
Share this post
Understanding Mamba
blog.trelis.com
Copy link
Facebook
Email
Note
Other
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts