For children ages 2 and 3, I would recommend the Read Aloud Bible Stories (volumes 1-4):
For children 3-5, I would recommend The Beginner’s Bible
and the Read with Me Bible
and The Big Picture Story Bible. It comes with CDs with page signals. It does not give many of the basic Bible stories but rather tries to give kids the overall story of the Bible.
Until Ryan turned five, the Jesus Storybook Bible was too abstract–in good reformed fashion showing how Jesus relates symbolically to every story. But he loved it at age 5. It is inspired by Tim Keller’s preaching.
And I would also recommend for children 2-5 Mary Manz Simon story books such as these two. They give illustrations for every aspect of the story–thus cementing the story.
And this looks good for five year olds as well:
You may be able to find these at your church library or public library but we have not been able to find them so Bibles are almost the only books we’ve bought.
