I haven't been able to find an automated way to do this. I see (at least) 3 ways to do it manually though. Each with its own pros and cons.
You drag the bottom cell height down to the bottom margin on each page.
PRO: It's easy to do. It won't affect the layout of other cells.
CON: It takes time. The bottom cell will have more bottom margin than the other cells. If you have to add or remove cells, you'll have to reset the cell heights and drag all the bottom cells once more.
You set the height of the cells to a fixed height (using the Exactly option as Daiaiai has explains in another answer).
PRO: Very simple solution. Has a clean look.
CON: You will have to choose a fixed height so the cell can contain any of the cell texts, or have different "Exactly" heights on different pages (the same height divided in 1, 2, 3, 4... - look into Table and Cell Styles for semi-automation). Cells with a short text might look empty.
On your master page you draw the outer rectangle of the table and give it the same fill and teal outer stroke. You also draw in the middle vertical orange line. You could place these objects on separate layers if it helps you. Now on the table, you remove the outer stroke, the fill color and the middle vertical orange stroke. With a little tweaking it can look exactly like solution 1.

PRO: Once set up it will be automated for every page. It won't affect the layout of the other cells.
CON: The bottom cell will have more bottom margin than the other cells.
(It would be nice to have a way to distribute the surplus height to all the cells on each page. It can be done manually by measuring and dividing, but it is too time consuming for page after page of tables.)