0
$\begingroup$

Which libraries can be used for image caption generation?

$\endgroup$
  • $\begingroup$ I'd consider this "asking for a development tool", which is off-topic. $\endgroup$ – Philip Raeisghasem Apr 28 '19 at 6:47
  • 1
    $\begingroup$ This seems a bit broad; I assume you’re looking for libraries with “black box” models? I doubt you haven’t heard of TensorFlow / Keras and PyTorch. I’m sure you can find some implementations in these libraries on github. Also look into FastAI; I don’t know if they have a black box model already written (I don’t really use it often), but they are very good so long as you don’t need to know too much about what’s under the hood. FastAI is built on top of PyTorch (but it’s starting to now branch out to other frameworks). $\endgroup$ – Hanzy Apr 28 '19 at 20:04
  • $\begingroup$ You can try to go to this source: hindawi.com/journals/cin/2020/3062706. $\endgroup$ – Nicho Santoso Apr 21 at 11:07
1
$\begingroup$

Image Caption Generation is an interesting problem to work on. I think your question was to know if there are any open-source libraries with built-in functions for Image Captioning. You can build Image Caption Generation models using Frameworks like Tensorflow, PyTorch, and Trax.

I'd also recommend you to read the following papers:

  1. Show and Tell: A Neural Image Caption Generator. Link
  2. Transfer learning from language models to image caption generators: Better models may not transfer better. Link
  3. Image Captioning with Unseen Objects. Link

Also, here are a couple of blog posts you can read:

| improve this answer | |
$\endgroup$
0
$\begingroup$

I've been read from some blogs, for image caption generation you can use concepts of a CNN and LSTM model and build a working model of Image caption generator by implementing CNN with LSTM. I think before you want to make something and using this project, you need to have good knowledge of Deep learning, Python, working on Jupyter notebooks, Keras library, Numpy, and Natural language processing and make sure that you have installed all the following necessary libraries: -pip install tensorflow -keras -pillow -numpy -tqdm -jupyterlab

source : https://data-flair.training/blogs/python-based-project-image-caption-generator-cnn/

| improve this answer | |
$\endgroup$

Not the answer you're looking for? Browse other questions tagged or ask your own question.