Schmidtt's review(pdf) seems to exhibit a comparatively constant drop from the time of European Speak to until finally about the start from the twentieth century (at which level their population started increasing again). The only bit in there that actually sticks out like a sore thumb was in 1804, when it appears nearly 50 % the remaining populace