The use of terahertz (THz) and optical radiation for electron acceleration and manipulation of electron bunches has progressed over the last decade to a level where practical devices for THz guns, THz and optical acceleration modules and a wide range of beam manipulations have become possible. Here, we discuss recent progress in optical driven Terahertz generation and its use in charged particle acceleration and beam manipulation devices. The advantages of using shorter wavelength radiation for acceleration are in overcoming breakdown phenomena, therefore enabling higher acceleration gradients than in conventional RF-accelerators albeit with lower bunch charge. The lower pulse energies needed to power the smaller cross section of the accelerating structures is also advantageous. In addition, the shorter wavelengths enable tighter timing control of the generated electron bunches but in return also need more precise timing when multiple stage interactions are required. Early results on THz guns, beam manipulation devices and accelerator structures are discussed as well as basic working principles of dielectric laser accelerators.