Pelayo Arbués

Recent Notes

  • AI Learning Paths for Software Engineers Without Becoming a Data Scientist

    May 21, 2025

  • Power and Prediction

    Apr 30, 2025

  • Why Software Engineers Should Learn a Bit of Data Science

    May 21, 2025

See 91 more →

Home

❯

Literature Notes

❯

Articles

❯

Large Models Are Expensive to Fine Tune on Downstream Tasks

Large Models Are Expensive to Fine-Tune on Downstream Tasks

Apr 16, 20251 min read

  • articles
  • literature-note

rw-book-cover

Metadata

  • Author: Sourab Mangrulkar
  • Full Title: Large Models Are Expensive to Fine-Tune on Downstream Tasks
  • URL: https://twitter.com/sourab_m/status/1624090029198020612

Highlights

  • With PEFT, you can fit the fine-tuning of very large models within consumer GPUs with support from other techniques like CPU offloading! (View Highlight)

Graph View

  • Metadata
  • Highlights

Now Reading

  • John Snow Probably Didn’t Use That Broad Street Map to Reach His Conclusions About Cholera

    Jun 11, 2025

See 1404 more →

Created with Quartz, © 2025

  • Bluesky
  • Linkedin
  • Mastodon
  • Twitter
  • Unsplash
  • GitHub
  • RSS