Colorectal cancer is cancer that starts in either your colon or your rectum. These make up the lower part of your digestive tract. In most cases, cancer does not start in both the colon and rectum. But both types of cancer have a lot in common. So they are often called colorectal cancer.