Gov. Jared Polis encouraged the president to move swiftly to reschedule cannabis and urged him to not let up on other incremental changes.