Documentation
¶
Index ¶
- Constants
- Variables
- func ScrapeAcademicCalendars(outDir string)
- func ScrapeAstra(outDir string)
- func ScrapeCometCalendar(outDir string)
- func ScrapeCoursebook(term string, startPrefix string, outDir string, resume bool)
- func ScrapeMapLocations(outDir string)
- func ScrapeMazevo(outDir string)
- func ScrapeOrganizations(outdir string)
- func ScrapeProfiles(outDir string)
- type APICalendarResponse
- type AcademicCalendar
- type RawEvent
Constants ¶
const API_KEY string = "0001085cc708b9cef47080f064612ca5"
API_KEY is the Concept3D API key observed from map.utdallas.edu traffic.
const BASE_URL string = "https://profiles.utdallas.edu/browse?page="
BASE_URL is the root listing endpoint for UTD professor profiles.
const CAL_URL string = "https://calendar.utdallas.edu/api/2/events"
const END_URL string = "/?map=" + UTD_MAP_ID + "&key=" + API_KEY
END_URL appends the map and key query parameters for Concept3D requests.
const START_URL string = "https://api.concept3d.com"
START_URL points to the Concept3D API host.
const UTD_MAP_ID string = "1772"
UTD_MAP_ID references the Concept3D map identifier for the UTD campus map.
Variables ¶
var MAX_EVENTS_PER_DAY = 5000
MAX_EVENTS_PER_DAY caps the Astra API results to guard against truncated responses.
Functions ¶
func ScrapeAcademicCalendars ¶
func ScrapeAcademicCalendars(outDir string)
func ScrapeAstra ¶
func ScrapeAstra(outDir string)
ScrapeAstra iterates day-by-day through Astra events and persists the raw JSON output.
func ScrapeCometCalendar ¶
func ScrapeCometCalendar(outDir string)
ScrapeCometCalendar retrieves calendar events through the API
func ScrapeCoursebook ¶
ScrapeCoursebook scrapes utd coursebook for the provided term (semester)
func ScrapeMapLocations ¶
func ScrapeMapLocations(outDir string)
ScrapeMapLocations downloads Concept3D responses and writes raw map data to disk.
func ScrapeMazevo ¶
func ScrapeMazevo(outDir string)
ScrapeMazevo pulls Mazevo calendar events via the public API and stores the raw response.
func ScrapeOrganizations ¶
func ScrapeOrganizations(outdir string)
ScrapeOrganizations authenticates with SharePoint and exports the student organization directory CSV.
func ScrapeProfiles ¶
func ScrapeProfiles(outDir string)
ScrapeProfiles navigates UTD profile listings and writes professor metadata to JSON.
Types ¶
type APICalendarResponse ¶
type APICalendarResponse struct {
Events []RawEvent `json:"events"`
Page map[string]int `json:"page"`
Date map[string]string `json:"date"`
}
APICalendarResponse models the calendar API pagination envelope.