The game needs referees. Referees are there to make sure the game is fair, fun, and safe. You are doing a service to the community and to the players, coaches, and fans. Just remember, people have been playing the beautiful game for a long time and some of the best games ever played were in backyards, parks, or backstreets without a single fan, coach or referee. Just players who wanted to play and just enjoy kicking the ball around. You are not bigger than the game.