It should be OK. I mean, it's not poisonous (I don't think). My main worry would be that the sharpness of the grass blades could cut the babies' tender skin. If you can, try to find something a bit softer and more comfortable. Otherwise, you could try cutting the lemon grass into short lengths so it can't wrap round legs or beaks.