Notebooks
L
LanceDB Social Media Caption Generation Llama3 2 11B

Social Media Caption Generation Llama3 2 11B

agentsllmsvector-databaselancedbgptopenaiAImultimodal-aimachine-learningembeddingsfine-tuningsocial-media-caption-generation-with-llama3.2examplesdeep-learninggpt-4-visionllama-indexragmultimodallangchainlancedb-recipes
alph-notebooks/lancedb-recipes / social_media_caption_generation_llama3_2_11B.ipynb

Social Media posts Caption generation using Llama-3.2 Vision

Thinking fancy captions for social media is boredom. Newly released Llama3.2 that supports image reasoning can do this task quite easily, This example notebook demonstrates it.

In this example, we'll use conceptual_captions dataset by Google Research. Image descriptions in the dataset are mainly utilized for searching relevant image and then utilizing the resultant image as an social media image for which we'll be generating fancy social media caption.

image.png

[ ]

Preprocessing dataset

[ ]
[ ]
[ ]
[ ]
0
[ ]

Setup LanceDB

[ ]
[ ]
[ ]
[2024-09-26T19:35:55Z WARN  lance::dataset] No existing dataset at /Users/lei/tmp/lancedb/conceptual_caption.lance, it will be created
[ ]
[ ]
[ ]
Link in first result is dead, trying next
using image from result 1
Output

Load model from Huggingface

NOTE: You'll need to agree to terms for using model from HF.

[ ]
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
[ ]
VBox(children=(HTML(value='<center> <img\nsrc=https://huggingface.co/front/assets/huggingface_logo-noborder.sv…
[ ]

Here are the social media post captions generated by Llama3.2-11B-Vision model

Here are some fancy captions you could use for each image:

  1. "A night to remember at the FX Justified premiere!"
  2. "Red carpet ready with my fellow cast members!"
  3. "The cast of Justified looking sharp at the premiere!"
  4. "A glimpse into the world of Justified!"
  5. "The stars of Justified shine bright on the red carpet!"
  6. "A night of drama and excitement at the Justified premiere!"
  7. "The talented cast of Justified brings the show to life!"
  8. "A behind-the-scenes look at the Justified premiere!"
  9. "The glamour of the Justified premiere!"
  10. "A night to remember with the cast of Justified!"

These captions are designed to be attention-grabbing and engaging, and can help to increase the visibility and reach of your images on social media. Feel free to customize them to fit your personal style and the tone of your post.

Voila ... You have finally utilized Llama3.2-11B-Vision model to generate fancy social media posts captions.