President Joe Biden is set to formally unveil a new student loan forgiveness plan, even as the administration continues to implement billions in debt relief.