I had started doing that 2 years ago and have not had any issues. This year I raised my raised bed another board higher and have been filling it with all my garden waste, egg cartons, leaves and kitchen scraps. It is breaking down nicely and has settled a lot. So come spring I will have to add a lot more compost to reach the top of the board.