Some are more... let's say' well-behaved' than others. This is where Pyroxene comes in, as you need it to craft gems. But you will need a lot more of it if you want to make these gems powerful.