My product has a module and further consists of non-electronic parts. Should the module only be tested and certified?

The RED requirements apply to the entire product, not just the radio module! Testing and certification is based per product, on the entire product.

Even if it is almost similar to your other product. It is per product. For each product you must do testing and certification.