Zero-shot finetuning examples

### Feature request @amyeroberts @qubvel @NielsRogge Does HF team intersted in adding zero-shot finetuning example like https://github.com/SangbumChoi/transformers/tree/grounding_examples/examples/pytorch/zero-shot? If the team merge these two following open PR then https://github.com/huggingface/transformers/pull/31828 https://github.com/huggingface/transformers/pull/31964 we can finetune the groundingdino and write something like this. https://blog.roboflow.com/how-to-fine-tune-paligemma/ I will left some model that you can run Model : https://huggingface.co/danelcsb/grounding-dino-tiny-finetuned-cppe-5-10k-steps-no-trainer/tree/main ### Motivation People can use zero-shot model to finetune there own projects. ### Your contribution I have made the branch already and ready to generate PR. Need some more modification. Before <img width="1002" alt="Screenshot 2024-08-06 at 6 08 57 PM" src="https://github.com/user-attachments/assets/92bbe009-91df-4be5-b786-eb998fe4c508"> After <img width="793" alt="Screenshot 2024-08-06 at 6 09 05 PM" src="https://github.com/user-attachments/assets/dec37ec9-f0fb-4ef4-93a9-a5575196e472">