Source data for suttacentral abbreviations page

chaz · January 18, 2022, 5:21am

Would some please be able to show me where the source data for the abbreviations page is kept in suttacentral? Looked for half an hour but couldn’t find it.

Khemarato.bhikkhu · January 18, 2022, 5:31am

I believe this csv file:

github.com

suttacentral/suttacentral/blob/master/server/server/search/table/uid_expansion.csv

uid,acro,name
an,AN,Aṅguttara Nikāya
ap,Ap,Āpadāna
arv,Arv,Arthaviniścaya
avs,Avs,Avadānaśataka
bv,Bv,Buddhavaṃsa
cnd,Cnd,Cūḷaniddesa
cp,Cp,Cariyāpiṭaka
da,DA,Dīrghāgama
kag,KA,Khuddakāgama
dhp,Dhp,Dhammapada
gdhp,G-Dhp,"Gāndhārī Dharmapada"
g2dhp,G-2-Dhp,"Gāndhārī Dharmapada British Library Fragment 16"
g3dhp,G-3-Dhp,"Gāndhārī Dharmapada Split Collection Fragment 3"
pdhp,P-Dhp,"Prākrit Dharmapada"
divy,Divy,Divyāvadāna
dk,Dk,Dharmaskandha
dn,DN,Dīgha Nikāya
dq,D,Derge/Peking editions
q,Q,"Qianlong (Peking edition of Tibetan canon)"

This file has been truncated. show original

chaz · January 18, 2022, 5:34am

Thank you, that’s what I was looking for!

chaz · January 18, 2022, 6:00am

Is the data in that directory up-to-date? For example, I notice that the csv files use “pi” for Pali, whereas the Vinaya segments seem to use “pli” instead…

Khemarato.bhikkhu · January 18, 2022, 6:04am

Those IDs don’t use these abbreviations. Those IDs are (I believe?) drawn from the folder names e.g. sc-data/sc_bilara_data/translation/en/brahmali/vinaya/pli-tv-kd at master · suttacentral/sc-data · GitHub

Sometimes they match (e.g. DN) but often they do not

Snowbird · January 18, 2022, 6:33am

Funny, I just asked Bhante about that a few hours ago! Haven’t heard back yet, but I will post when I do.

I don’t believe the csv @Khemarato.bhikkhu linked to is the (direct?) source for the abbreviations page linked by the OP. For example, on the front end page there is this…

Whereas in the csv it shows this:

Snowbird · January 18, 2022, 6:45am

Ok, I may have found it! Not sure if it is the real source, but it has “Pts” for the item I showed above:

github.com

suttacentral/sc-data/blob/master/sc_bilara_data/root/en/site/abbreviations_root-en-site.json

{
  "abbreviations:1": "Abbreviations",
  "abbreviations:2": "SuttaCentral is structured around the idea of a distinct entity—usually a sutta, Vinaya rule, or section of text—which has a unique identity. That identity is represented by an abbreviation, which serves both to label the text and to create the <span class='smallcaps'>URL</span> for that text. These abbreviations are as short and flexible as we can make them. While we don’t arbitrarily depart from accepted usage, in certain cases the special requirements of SuttaCentral have meant we have adopted new abbreviations. All abbreviations must satisfy the following criteria.",
  "abbreviations:3": "Unique across the entire SuttaCentral corpus;",
  "abbreviations:4": "No special characters or diacritical marks (as these can’t be used in <span class='smallcaps'>URL</span>s);",
  "abbreviations:5": "Case insenstive;",
  "abbreviations:6": "Usually two, hopefully no more than three characters long;",
  "abbreviations:7": "Conforming to recognized standards and conventions such as <span class='smallcaps'>ISO</span>.",
  "abbreviations:8": "To keep the list a reasonable length we omit language codes, which use the two-letter <span class='smallcaps'>ISO</span> 639-1 for modern languages, and the three-letter ISO 639-3 codes for ancient languages.",
  "abbreviations:9": "List of Abbreviations",
  "abbreviations:10": "-a",
  "abbreviations:11": "Aṭṭhakathā",
  "abbreviations:12": "Ab",
  "abbreviations:13": "Abhidhamma",
  "abbreviations:14": "ACIP",
  "abbreviations:15": "Asian Classics Input Project",
  "abbreviations:16": "AN",
  "abbreviations:17": "Aṅguttara Nikāya",
  "abbreviations:18": "Arv",
  "abbreviations:19": "Arthaviniścaya",

This file has been truncated. show original

How did I find it? I already had the sc-data repository copied to my local device. Then I just used Sublime Text to search the whole directory for “List of Abbreviations”.

I actually always seem to forget that this can be done.

Khemarato.bhikkhu · January 18, 2022, 7:08am

Oh! Seems you may be right

github.com

suttacentral/suttacentral/blob/master/client/elements/static/sc-static-abbreviations.js

import { html } from 'lit';
import { unsafeHTML } from 'lit/directives/unsafe-html.js';

import { layoutSimpleStyles } from '../styles/sc-layout-simple-styles';
import { typographyCommonStyles } from '../styles/sc-typography-common-styles';
import { typographyStaticStyles } from '../styles/sc-typography-static-styles';
import { SCStaticPage } from '../addons/sc-static-page';

class SCStaticAbbreviations extends SCStaticPage {
  createRenderRoot() {
    return this;
  }

  render() {
    return html`
      <style>
        ${layoutSimpleStyles}
        ${typographyCommonStyles}
        ${typographyStaticStyles}
      </style>

This file has been truncated. show original

Snowbird · January 18, 2022, 7:17am

Sorry if this is kind of a derail, but can you tell why that table is built manually? I would have thought the whole purpose of having the data in an object would be so you didn’t have to update two places when changing the data.

Khemarato.bhikkhu · January 18, 2022, 7:19am

I kind of assumed that it was, like most files in SuttaCentral, generated by a script at some point.

It’s very hard to tell in their code which files are actually source code and which are intermediate files generated by scripts

Snowbird · January 18, 2022, 7:25am

Ah, so the live site is actually built and then the pages are uploaded to the real server? I have much more experience with WordPress where it’s all done on the fly.

Khemarato.bhikkhu · January 18, 2022, 7:31am

Yes, there are several steps between e.g. finding a translation online and seeing it live on SuttaCentral… but I’ve never done it myself so I don’t actually know what those steps are…

Khemarato.bhikkhu · January 18, 2022, 7:34am

Perhaps Bhante @Sujato can point us to some documentation? How would one go about making a change to the abbreviations page?

sujato · January 18, 2022, 8:59am

The source file is supplied by Snowbird above.

For converting Ids in data we use:

github.com

suttacentral/sc-data/blob/master/misc/uid_expansion.json

[
  {
    "uid": "an",
    "acronym": "AN",
    "name": "Aṅguttara Nikāya"
  },
  {
    "uid": "ap",
    "acronym": "Ap",
    "name": "Āpadāna"
  },
  {
    "uid": "arv",
    "acronym": "Arv",
    "name": "Arthaviniścaya"
  },
  {
    "uid": "avs",
    "acronym": "Avs",
    "name": "Avadānaśataka"

This file has been truncated. show original

The .csv file is deprecated, it’s just used in search for now, it will be removed.

Only because I put it together years ago and that’s all I knew!

Static page are basically all hand-built, not from data.

They are only composed for the sake of localization. The static files include l10n keys, the content is in site files in sc-data. Here’s the root english files.

Not quite. The raw data from the JSON files is scooped up (when SC is restarted or on data-load) and added to our DB. Then, much like Wordpress, we query the DB to create a REST API. JSON arrives at the front end, and it’s stamped into HTML using lit-element.