Transformer-based Networks for Predicting Time-Varying Cascaded and Direct Channels in RIS-Assisted mmWave Systems