KS: Committees Data Not Available - SBee

Description

SupportBee - https://sunlightfoundation.supportbee.com/tickets/4474188

Hello Paul,

It's been a while since we've had any issues, but we're running into a problem in the Committees area of the feeds for the Kansas Legislature. Several of the senate committes (Assessment and Taxation for one) aren't returning any members, it's that way in the app we build for Kansas Chamber and also in your open states app.

Kris

Activity

Show:
Clifton McIntosh
March 13, 2016, 2:15 PM

Is the lack of data about committee members because the Kansas legislature API requires that request speed be throttled? When I ran the Kansas committee scraper, most of the requests returned a 429 and a message explaining that my request rate was too high. Would implementing a throttling mechanism for Kansas committees be what is necessary to get the data?

Here are the headers and body of the response I received while running the scraper:

Headers

Response Body

Clifton McIntosh
March 20, 2016, 5:04 PM

Here is a pull request for throttling the requests in the committees scraper when the KS legislature API sends a 429: https://github.com/sunlightlabs/openstates/pull/1053

Assignee

Andy Lo

Reporter

dmclamb

Priority

Normal
Configure