8 points | by amulyabaral an hour ago
2 comments
I’m honestly surprised this is better benchmark wise than the text only model. I figured the addition of vision would take away from some of the text capabilities.
One of the early results from multimodal training is that it kinda works like cross training. Training vision helps with text tasks and visa versa.
I’m honestly surprised this is better benchmark wise than the text only model. I figured the addition of vision would take away from some of the text capabilities.
One of the early results from multimodal training is that it kinda works like cross training. Training vision helps with text tasks and visa versa.