This study reports the facile preparation and the dye removal efficiency of nanohybrids composed of graphene oxide (GO) and Fe3O4 nanoparticles with various geometrical structures. In comparison to previously reported GO/Fe3O4 composites prepared through the one-pot, in situ deposition of Fe3O4 nanoparticles, the GO/Fe3O4 nanohybrids reported here were obtained by taking advantage of the physical affinities between sulfonated GO and Fe3O4 nanoparticles, which allows tuning the dimensions and geometries of Fe3O4 nanoparticles in order to decrease their contact area with GO, while still maintaining the magnetic properties of the nanohybrids for easy separation and adsorbent recycling. Both the as-prepared and regenerated nanohybrids demonstrate a nearly 100% removal rate for methylene blue and an impressively high removal rate for Rhodamine B. This study provides new insights into the facile and controllable industrial scale fabrication of safe and highly efficient GO-based adsorbents for dye or other organic pollutants in a wide range of environmental-related applications.