Partial Search Broken?

I tried a partial search for “osāre”

https://suttacentral.net/search?query=osāre

and got back zero results. I have Pāḷi root language checked in the Languages tab.

This word definitely appears in the suttas, for example in DN 16

1 Like

All sorts of things are broken on search right now.

Always ping @HongDa.

2 Likes

Yes, I’ve seen some issues too, not sure what’s happened. But i’ve had such erratic access to internet I couldn’t be sure of anything.

Would it not be a good idea to set up some kind of automated regression testing for search?

You can use Selenium for testing at the browser level, or use the backend API directly. If anything breaks add a test. Likewise when adding a feature, add a test. Add the tests to your github actions CI workflow to catch problems before deployment.

Basically you’re just comparing input - the search string - to output - the results returned. If anything changes, fail the test.

Sorry I don’t have the time myself right now, but it’s something I’d look into.

3 Likes

Absolutely. It has been mentioned many times.

I just want to add that, I tried searching for “raft” and couldn’t find it at all in the suttas. Chrome / Ubuntu.

Always ping @HongDa. :sweat_smile:

Well, yes, but he is away for lunar newyears. So multiple pings don’t help in this case.

Until he gets back we all need to be patient. No point in even reporting bugs. It could just be that a database needs to be rebuilt and that will solve it all.

In the meantime, we can all just use Google search, putting site:suttacentral.net in the search string.

2 Likes

Always ping thank @HongDa!

3 Likes

Oh, sorry, this is because I didn’t re-index after fixing a problem recently. I have fixed this problem now.

6 Likes

@HongDa - The site is partially down again? Lots of things are failing to load for me at the moment.

1 Like

More than just partial search? Partial search is working for me. I tried “food”. Got 2798 results. It was slow, though.

2 Likes

Linode reported a high CPU usage issue on the server, which may be the cause of the slow response. I am observing.

1 Like

Yes. Search, but also the three basket cards on the homepage, some of the parallels menus were empty…

1 Like

I restarted the server and now it seems to be back to normal.

1 Like

Hey mate,

Did this occur when make load-data was executed?

Perhaps we could monitor the load over a 7 day period and see what happens next time we run it. A chart of CPU, RAM, disk and network usage would be valuable.

EDIT: Oh goody, that should be easy:

https://www.linode.com/products/monitoring/

1 Like

If I understand what is happening (which I very well may not!) The load is when doing a search that includes multiple terms, like red AND house AND food.

Previously red house food was taken as a literal, but recently it was changed to automatically be a multiple AND search by default (without quote marks surrounding it). And that was when we started seeing the search problems.

And I think that this PR disabled that functionality: Temporarily disable the ability to split search statements. by ihongda · Pull Request #3365 · suttacentral/suttacentral · GitHub

But again, I could be totally misunderstanding what is going on. I just give that as background.

1 Like

OK. Could be ArangoDB struggling on read requests for this type of search query, and also falling over when make load-data does a whole lot of writes. But I’m speculating. It will take a bit of time to uncover the source of the problem, especially if we have two interacting issues.

1 Like