Depending on what the actors are doing it may slow down. Generally speaking unless you are doing large scale loops or similar in draw events, the actual code you use won't cause too much slow down. Things to watch out for are use of collisions in a lot of actors, and a lot of draw actor events. If you keep that in mind, generally speaking your game will run fine.