I would say so, just be smart about it if you're doing it alone. Also remember that you will need to successfully sell an hours worth of weed to recover the money you spent on the barn.
You could try farming potatoes? I know they're not as good, but if you left them on to farm whilst you do...