See the required PDF specifications for the advised settings.
By reducing the resolution (dpi) of your file, you can reduce the PDF size. You can also minimize the number and complexity of forms and flatten layers, especially at complex pages.
Do a text-recognition OCR scan before uploading your PDF to ensure it is optimized for search.