the only issue is diamonds and sapphires are too similar in color, so making ores out of them would be hard to do.
Remember, Lapis is dark blue.
Diamonds are light blue.
Unless we make them yellow or orange, they would look odd.
We would have to go with purple if they did
