Take the dinosaurs for example, well the t-Rex's teeth were sharp so paleontologist believe they ate other living animals. Brachiosaurus Had flat teeth, so paleontologist believed that they were plant eaters. So yes fossils can provide evidence of their diets.
