It has one of the same inherent inefficiencies as animal meat: they need to eat something to grow. Therefore we need to use a lot of resources to produce a lot of food for them to eat, before we can eat them.
It always seems much more efficient to use those resources to grow food for us to eat directly. Also, getting Americans to eat a vegetable is slightly easier than getting them to eat a bug.