The only way I found to make it quicker is extract subdirectories as separate shares.... for instance instead of sharing the directory "Movies" share subdirectories as per say movie genre "SciFi", "Drama" etc. Adding a new file and refreshing the library makes it borderline bearable.
Having said that, gonna try the Serviio.


















...