What can you do? The pillager no longer spawns in the outpost.
Not at all. Unless you're programming a mod
Either you choose peaceful or if you play creative you can place a command block with the command / kill @e [type = pillager]. You then set it to always active, unconditional, repeating.
Then the outpost is not a good base after all