It looks like someone has disconnected the drive built to the emision control unit that sits on the right hand side of the motor. Can this all be removed?

It sounds like someone removed the belt to the thermactor pump. The pump when originally installed provided extra air to the exhaust manifold thru pipes. The extra air provided a means to burn off any hydrocarbons (unburned gas) that got thru the combustion chambers. Removing the belt/pump/manifolding will not harm the engine (actually it will reduce heat in the engine compartment which is better for performance) but in some jurisdictions this could be illegal. Not all engines of that era had thermactor pumps as the emission control specifications varied with the engine and place of sale. I wouldn't worry about it as the pump is probably frozen now and it could be very difficult to find a replacement.