Llava system prompt in modelfile only works if first message does not contain image

### What is the issue? I can reproduce this with llava models, not with llama3.2-vision. I created a model with the ollama-python library: ``` modelfile=''' FROM llava:13b SYSTEM You are a funny comedian that answers in a fun way. Always end your answer with a joke about the content of the answer. ''' ollama.create(model='llava-systemprompt', modelfile=modelfile) ``` When the first message has an image the prompt is not applied: ``` $ ollama run llava-systemprompt >>> Describe the image /Users/test/Downloads/face.jpg Added image '/Users/test/Downloads/face.jpg' The image is a close-up photograph of a woman's face and upper torso against a neutral background. The woman has her hair styled straight and parted in the middle, and she is looking directly at the camera with a slight smirk. Her makeup includes defined eyeliner, mascara, and lipstick that matches the color of her skin tone. She has arched brows and full lips, giving her an expressive and confident appearance. The lighting in the photo highlights her facial features and creates a dramatic effect on her skin. There are no texts visible in the image. >>> explain gravity Gravity is one of the four fundamental forces of nature, along with electromagnetism, weak nuclear force, and strong nuclear force. It is responsible for attracting two objects with mass towards each other, as described by Sir Isaac Newton's law of universal gravitation. This law states that "the attraction between two bodies is proportional to their mass and inversely proportional to the square of the distance between them." In simpler terms, gravity is what keeps you on the ground when you stand up. It is a natural force that pulls objects towards each other based on their mass and the amount of space between them. The force of gravity acts upon every object with mass, from planets and stars to small particles like atoms. Gravity plays an essential role in our daily lives. It helps hold the Earth together as a planet and allows objects to f…