Sefness, is the house old or new? If it is old and you have galvanized plumbing, it is likely that you have rust in the pipes.
Do you know what kind of pipes you have? Options :
steel (magnet sticks)
copper - color of a penny, magnet will not stick
plastic, usually white.