All

18 repositories

twigvlm
Public
Implementation of ICCV 2025 paper "Growing a Twig to Accelerate Large Vision-Language Models".
pytorch inference-acceleration token-pruning
pytorch inference-acceleration token-pruning vision-language-models
Python
•
Apache License 2.0
•3•28•0•0•Updated Apr 15, 2026Apr 15, 2026
videoarm
Public
Python
•
Apache License 2.0
•0•12•1•0•Updated Apr 9, 2026Apr 9, 2026
engineering-practices-of-llms
Public
A course that systematically introduces the foundations and engineering practices of LLMs
Python
•2•4•0•0•Updated Jan 27, 2026Jan 27, 2026
smvqa
Public
A VQA benchmark with Street-map Images
Python
•
Apache License 2.0
•1•1•0•0•Updated Nov 17, 2025Nov 17, 2025
prophet
Public
Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".
pytorch visual-question-answering multimodal-deep-learning
pytorch visual-question-answering multimodal-deep-learning gpt-3 prompt-engineering okvqa a-okvqa
Python
•
Apache License 2.0
•28•278•4•0•Updated Jun 14, 2025Jun 14, 2025
imp
Public
a family of highly capabale yet efficient large multimodal models
Python
•
Apache License 2.0
•15•193•3•3•Updated Aug 23, 2024Aug 23, 2024
mlc-imp
Public
Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
Python
•
Apache License 2.0
•2k•14•0•0•Updated May 29, 2024May 29, 2024
anetqa
Public template
HTML
•1•0•0•0•Updated Mar 15, 2024Mar 15, 2024
anetqa-code
Public
Python
•
Apache License 2.0
•2•9•1•0•Updated Mar 7, 2024Mar 7, 2024
rosita
Public
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
vqa vision-and-language pre-training
vqa vision-and-language pre-training referring-expression-comprehension image-text-retrieval
Python
•
Apache License 2.0
•13•57•1•0•Updated Jun 13, 2023Jun 13, 2023
bst
Public
Python
•
Apache License 2.0
•1•5•0•0•Updated May 12, 2023May 12, 2023
xmchat
Public
Apache License 2.0
•2•30•3•0•Updated Apr 24, 2023Apr 24, 2023
bottom-up-attention.pytorch
Public
A PyTorch reimplementation of bottom-up-attention models
pytorch bottom-up-attention detectron2
pytorch bottom-up-attention detectron2
Jupyter Notebook
•
Apache License 2.0
•76•301•26•0•Updated Apr 7, 2022Apr 7, 2022
openvqa
Public
A lightweight, scalable, and general framework for visual question answering research
benchmark deep-learning pytorch
benchmark deep-learning pytorch vqa visual-question-answering
Python
•
Apache License 2.0
•65•331•6•0•Updated Sep 3, 2021Sep 3, 2021
mcan-vqa
Public
Deep Modular Co-Attention Networks for Visual Question Answering
attention visual-reasoning visual-question-answering
attention visual-reasoning visual-question-answering
Python
•
Apache License 2.0
•89•458•1•0•Updated Dec 16, 2020Dec 16, 2020
activitynet-qa
Public
An VideoQA dataset based on the videos from ActivityNet
dataset vqa activitynet
dataset vqa activitynet videoqa
Python
•
Apache License 2.0
•10•91•2•0•Updated Nov 22, 2020Nov 22, 2020
mmnas
Public
Deep Multimodal Neural Architecture Search
Python
•
Apache License 2.0
•9•29•1•0•Updated Nov 15, 2020Nov 15, 2020
mt-captioning
Public
A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning
pytorch image-captioning multimodal-transformer
pytorch image-captioning multimodal-transformer
Python
•
Apache License 2.0
•7•25•1•1•Updated Sep 4, 2020Sep 4, 2020

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Vision and Language Group@ MIL

All

All

18 repositories

twigvlm

videoarm

engineering-practices-of-llms

smvqa

prophet

imp

mlc-imp

anetqa

anetqa-code

rosita

bst

xmchat

bottom-up-attention.pytorch

openvqa

mcan-vqa

activitynet-qa

mmnas

mt-captioning

All

All

Repositories list

18 repositories