The main distinction between primary storage and secondary storage lies in their speed and usage. Primary storage, such as RAM, is fast and directly accessible by the CPU, making it suitable for active processes. In contrast, secondary storage, including hard drives and solid-state drives, is used for long-term data retention but has slower access speeds.