While there isn't a specific age of onset for rectal and colon cancers, cases of rectal cancer are generally observed after the age of 35. The vast majority of patients are in the age groups of 50 and above.