| name | iwafu |
| description | Platform rules, Taiwan relevance gate, false-positive filters, and troubleshooting for the iwafu scraper |
| applyTo | scraper/sources/iwafu.py |
iwafu Scraper — Platform Reference
Platform Profile
| Field | Value |
|---|
| Site URL | https://www.iwafu.com |
| Search URL | https://www.iwafu.com/jp/events?keyword=台湾&prefecture=東京 |
| Rendering | JS-heavy — requires Playwright (sync_playwright) |
| Auth required | No |
| Rate limit | Implicit (no hard throttle; add 0.5 s between detail pages) |
| Source name | iwafu |
| Source ID format | iwafu_{numeric_id} (extracted from /jp/events/{id}) |
Field Mappings
| Event Field | iwafu Source |
|---|
source_id | iwafu_{numeric_id} from URL path (stable) |
raw_title | <h1> on detail page |
start_date | _parse_date() from card date range, confirmed on detail page |
end_date | End of date range on card; falls back to start_date if single-day |
location_name | 場所[：:]\s*(.+?) from main_text; fallback: card.prefecture |
location_address | Same value as location_name (set both) |
raw_description | Detail page main.inner_text(), trimmed at first _NOISE_MARKER |
Taiwan Relevance Gate
All events are fetched with keyword=台湾 — iwafu applies the search server-side.
However a second relevance check is mandatory because iwafu search results can include:
- Global / nationwide tour events where Taiwan is merely one stop.
- IP entertainment series (escape rooms, anime tie-ins) that visit Taiwan venues.
Global-tour false positive
Reject if description matches _GLOBAL_TOUR_PATTERNS:
_GLOBAL_TOUR_PATTERNS = re.compile(
r"台湾など世界各地|台湾など.*各地|全国各地.*台湾|世界各地.*台湾|台湾.*世界各地"
r"|全国[0-9０-９]+[都道府県施設箇所].*台湾|台湾.*全国[0-9０-９]",
re.DOTALL,
)
Taiwan must be the theme or primary focus, not just one venue.
Title-level block (_BLOCKED_TITLE_PATTERNS)
Known IP series where all events are non-Taiwan-themed:
_BLOCKED_TITLE_PATTERNS = re.compile(
r"リアル脱出ゲーム.*名探偵コナン|名探偵コナン.*リアル脱出ゲーム"
r"|名探偵コナン.*脱出|脱出.*名探偵コナン",
)
Check card title before loading the detail page (fast reject by card title, saves Playwright loads).
Permanent series block (_BLOCKED_SERIES)
IP series where every event is confirmed non-Taiwan-themed. Checked on BOTH card title AND <h1> on detail page (card titles can be truncated).
_BLOCKED_SERIES = re.compile(
r"名探偵コナン",
)
Add new series entries here when an IP is confirmed.
Location Extraction
- Primary: regex
場所[：:]\s*(.+?)(?:\n|交通手段|Q&A|https?://|$) on main_text.
- Set both
location_name and location_address to the captured value.
- Fallback:
card.prefecture (e.g. "東京") — only when 場所： label is absent.
- Never store bare prefecture names as
location_address — they will be flagged by backfill_locations.py.
Address Regex Rules（_ADDR_RE）
_ADDR_RE は以下のパターンで日本の住所を抽出する：
_ADDR_RE = re.compile(
r'(?:〒\d{3}-\d{4}\s*\n?\s*)?'
r'(?:(?:東京都|北海道|(?:大阪|京都)府|.{2,5}[都道府県])\s*)?'
r'(?:[^\s（(]{1,4}[市区町村])'
r'.{1,30}?[0-9０-９]+(?:[-ー―][0-9０-９]+)+'
)
重要：都道府縣は optional。日本の住所は都道府縣を省略して市区町村から始まることが多い（例: 渋谷区〇〇1-2-3）。[市区町村] の suffix が唯一の必須 anchor。
Official Site Body Text Fallback（official_body_text）
iwafu 本文（main_text）で住所が見つからない場合、official site の body text をフォールバックとして使用する：
_fetch_official_organizer_info(page, official_url) は 3-tuple を返す：
(organizer, supplemental_text, body_text)body_text は公式サイトの全テキスト（page.inner_text("body")）main_text で _ADDR_RE がマッチしない場合のみ、official_body_text を検索する（追加 Playwright フェッチなし）
addr_m = _ADDR_RE.search(main_text)
if addr_m is None and official_body_text:
addr_m = _ADDR_RE.search(official_body_text)
注意： _fetch_official_organizer_info の戻り値は 3-tuple。呼び出し元は必ず 3 つの変数で受け取ること：
official_organizer, official_credits_text, official_body_text = (
_fetch_official_organizer_info(page, official_url)
)
Description Trimming
_NOISE_MARKERS defines UI section headers that signal the start of noise content.
Trim raw_description at the first occurrence of any marker (ordered list, first match wins):
_NOISE_MARKERS = (
"Q&A イベントについて",
"近くの看板",
"近くのイベント",
"地図検索に切り替えて",
)
DB Audit Rule
After adding a new filter (blocking pattern or series entry):
- Run
ilike("raw_title", "%keyword%") on the events table to find existing records.
- Hard-delete or deactivate them — the filter only prevents future inserts.
- Prefer hard-delete (
table.delete().eq("id", eid)) for permanently non-Taiwan-themed series.
Pending Rules
