We are excited to release a massive update to Hugging Face AI Sheets, the open-source tool for building, transforming, and enriching data with open AI models. AI Sheets leverages Inference Providers, which means you can use thousands of open models powered by the best inference providers on the planet. (View Highlight)
The first version of AI Sheets made structuring and enriching textual content a breeze. Now, we’re adding vision to AI Sheets.
Images are everywhere—product photos, receipts, screenshots, diagrams, charts, logos. These documents contain structured information waiting to be extracted, analyzed, and transformed. Today, you can finally work with visual content directly in AI Sheets: view images, analyze them, extract information, generate new ones, and even edit them in real-time —all in the same workflow. (View Highlight)
What you can do:
• Describe and categorize images - Generate captions for product photos, classify document types, or tag images by content
• Extract structured data - Pull line items from receipts, data from charts, or text from scanned documents
• Add context and metadata - Automatically label images with relevant attributes, quality scores, or custom annotations (View Highlight)
Imagine you’re back from a trip with a stack of receipts. Upload them to AI Sheets and create a column with a prompt like: Extract the merchant name, date, total amount, and expense category from this receipt
AI Sheets processes each receipt and gives you a clean table with all the details extracted. You can edit any mistakes, validate good results with thumbs-up, and regenerate to improve the rest. Export the final dataset as CSV or Parquet for your expense tracking tool. (View Highlight)
Or maybe you’re digitizing handwritten recipes from old family notebooks. Create columns to extract ingredients, cooking time, and cuisine type—turning your personal archive into a searchable, structured dataset. (View Highlight)
Need visuals for your content? AI Sheets can generate and edit images directly in your spreadsheet using AI models, keeping your entire content creation workflow in one place.
What you can do:
• Generate images from text - Create social media graphics, thumbnails, or illustrations that match your content
• Edit and transform existing images - Modify uploaded images or generated visuals—change styles, add elements, adjust compositions
• Create variations at scale - Generate multiple versions or styles to test what resonates with your audience
• Build visual content libraries - Produce consistent branded assets across large content campaigns (View Highlight)
Image columns come with image operations like extracting text, asking the image, object detection, colorization, adding text, and any custom action you can think of.
Text columns include summarization, keyword extraction, translation, and custom actions.
A prompt and a model define every AI action. Let’s see what we can do with our handwritten recipes dataset! (View Highlight)
