Structural Beauty A Structure based Approach to Quantifying the Beauty of an Image. To say that beauty is in the eye of the beholder means that beauty is largely subjective so varies from person to person. While the subjectivity view is commonly held, there is also an objectivity view that seeks to measure beauty or aesthetics in some quantitative manners. Christopher Alexander has long discovered that beauty or coherence highly correlates to the number of subsymmetries or substructures and demonstrated that there is a shared notion of beauty structural beauty among people and even different peoples, regardless of their faiths, cultures, and ethnicities. This notion of structural beauty arises directly out of living structure or wholeness, a physical and mathematical structure that underlies all space and matter. Based on the concept of living structure, this paper develops an approach for computing the structural beauty or life of an image (L) based on the number of automatically derived substructures (S) and their inherent hierarchy (H). To verify this approach, we conducted a series of case studies applied to eight pairs of images including Leonardo da Vinci's Mona Lisa and Jackson Pollock's Blue Poles. We discovered among others that Blue Poles is more structurally beautiful than the Mona Lisa, and traditional buildings are in general more structurally beautiful than their modernist counterparts. This finding implies that goodness of things or images is largely a matter of fact rather than an opinion or personal preference as conventionally conceived. The research on structural beauty has deep implications on many disciplines, where beauty or aesthetics is a major concern such as image understanding and computer vision, architecture and urban design, humanities and arts, neurophysiology, and psychology. Keywords Life wholeness figural goodness head tail breaks computer vision


CARL Conditional value at risk Adversarial Reinforcement Learning. In this paper we present a risk averse reinforcement learning (RL) method called Conditional value at risk Adversarial Reinforcement Learning (CARL). To the best of our knowledge, CARL is the first game formulation for Conditional Value at Risk (CVaR) RL. The game takes place between a policy player and an adversary that perturbs the policy player's state transitions given a finite budget. We prove that, at the maximin equilibrium point, the learned policy is CVaR optimal with a risk tolerance explicitly related to the adversary's budget. We provide a gradient based training procedure to solve CARL by formulating it as a zero sum Stackelberg Game, enabling the use of deep reinforcement learning architectures and training algorithms. Finally, we show that solving the CARL game does lead to risk averse behaviour in a toy grid environment, also confirming that an increased adversary produces increasingly cautious policies.


Stable discontinuous stationary solutions to reaction diffusion ODE systems. A general system of n ordinary differential equations coupled with one reaction diffusion equation, considered in a bounded N dimensional domain, with no flux boundary condition is studied in a context of pattern formation. Such initial boundary value problems may have different types of stationary solutions. In our parallel work Instability of all regular stationary solutions to reaction diffusion ODE systems (2021) , regular (i.e. sufficiently smooth) stationary solutions are shown to exist, however, all of them are unstable. The goal of this work is to construct discontinuous stationary solutions to general reaction diffusion ODE systems and to find sufficient conditions for their stability.


Simulation of semiconductor detectors in 3D with SolidStateDetectors.jl. The open source software package SolidStateDetectors.jl to calculate the fields and simulate the drifts of charge carriers in solid state detectors, together with the corresponding pulses, is introduced. The package can perform all calculations in full 3D while it can also make use of detector symmetries. The effect of the surroundings of a detector can also be studied. The package is programmed in the user friendly and performance oriented language Julia, such that 3D field calculations and drift simulations can be executed efficiently and in parallel. While all kinds of semiconductor devices can be simulated, special emphasis is put on germanium detectors. The verification of the package is shown for an n type segmented point contact germanium detector. Additional features of SolidStateDetectors.jl planned for the near future are listed.


Scalable higher order exceptional surface with passive resonators. The sensitivity of perturbation sensing can be effectively enhanced with higher order exceptional points due to the nonlinear response to frequency splitting. However, the experimental implementation is challenging since all the parameters need to be precisely prepared. The emergence of exceptional surface (ES) improves the robustness of the system to the external environment, while maintaining the same sensitivity. Here, we propose the first scalable protocol for realizing photonic high order exceptional surface with passive resonators. By adding one or more additional passive resonators in the low order ES photonic system, the 3 or arbitrary N order ES is constructed and proved to be easily realized in experiment. We show that the sensitivity is enhanced and experimental demonstration is more resilent against the fabrication errors. The additional phase modulation effect is also investigated.


Omnidirectional nonreciprocal absorber realized by the magneto optical hypercrystal. Photonic bandgap design is one of the most basic ways to effectively control the interaction between light and matter. However, the traditional photonic bandgap is always dispersive (blueshift with the increase of the incident angle), which is disadvantageous to the construction of wide angle optical devices. Hypercrystal, that the photonic crystal with layered hyperbolic metamaterials (HMMs), can strongly modify the bandgap properties based on the anomalous wavevector dispersion of the HMM. Here, based on phase variation compensation between HMM and isotropic dielectric layers, we propose for the first time to design nonreciprocal and flexible photonic bandgaps using magneto optical HMMs in one dimensional photonic crystals. Especially for the forward and backward incident light, the blueshift and dispersionless of the forward and backward cavity modes are designed respectively to realize the interesting omnidirectional nonreciprocal absorber. Our results show high (low) absorption about 0.99 (0.25) in an angle range of 20 75 degrees for the forward (backward) incident light at the wavelength of 367 nm. The nonreciprocal omnidirectional cavity mode not only facilitates the design of perfect unidirectional optical absorbers working in a wide angle range, but also possesses significant applications for all angle reflectors and filters.


Improved Observation of Transient Phenomena with Doppler Radars a Common Framework for Oceanic and Atmospheric Sensing. Doppler radars are routinely used for the remote sensing of oceanic surface currents and atmospheric wind profiles. Even though they operate at different frequencies and address different media, they follow very similar processing for the extraction of measured velocities. In particular they both face the challenging issue of capturing geophysical phenomena which vary rapidly with respect to the typical integration time. Recently, the authors applied a non spectral formalism based on autoregressive processes to model the backscattered time series obtained from High Frequency oceanic radars. They showed that it allows to calculate Doppler spectra for very short integration times without losing in frequency resolution nor signal to noise ratio. We apply this technique to synthetic and experimental data within a common framework and show for the first time the strong potential of the method for the study of transient atmospheric phenomena.


Region Similarity Representation Learning. We present Region Similarity Representation Learning (ReSim), a new approach to self supervised representation learning for localization based tasks such as object detection and segmentation. While existing work has largely focused on solely learning global representations for an entire image, ReSim learns both regional representations for localization as well as semantic image level representations. ReSim operates by sliding a fixed sized window across the overlapping area between two views (e.g., image crops), aligning these areas with their corresponding convolutional feature map regions, and then maximizing the feature similarity across views. As a result, ReSim learns spatially and semantically consistent feature representation throughout the convolutional feature maps of a neural network. A shift or scale of an image region, e.g., a shift or scale of an object, has a corresponding change in the feature maps this allows downstream tasks to leverage these representations for localization. Through object detection, instance segmentation, and dense pose estimation experiments, we illustrate how ReSim learns representations which significantly improve the localization and classification performance compared to a competitive MoCo v2 baseline 2.7 AP text bb 75 VOC, 1.1 AP text bb 75 COCO, and 1.9 AP text mk Cityscapes. Code and pre trained models are released at url https github.com Tete Xiao ReSim


Numbers which are only orders of abelian or nilpotent groups. Refining a result of Erdos and Mays, we give asymptotic series expansions for the functions A(x) C(x) , the count of n leq x for which every group of order n is abelian (but not all cyclic), and N(x) A(x) , the count of n leq x for which every group of order n is nilpotent (but not all abelian).


baller2vec A Look Ahead Multi Entity Transformer For Modeling Coordinated Agents. In many multi agent spatiotemporal systems, agents operate under the influence of shared, unobserved variables (e.g., the play a team is executing in a game of basketball). As a result, the trajectories of the agents are often statistically dependent at any given time step however, almost universally, multi agent models implicitly assume the agents' trajectories are statistically independent at each time step. In this paper, we introduce baller2vec , a multi entity Transformer that can effectively model coordinated agents. Specifically, baller2vec applies a specially designed self attention mask to a mixture of location and "look ahead" trajectory sequences to learn the distributions of statistically dependent agent trajectories. We show that, unlike baller2vec (baller2vec 's predecessor), baller2vec can learn to emulate the behavior of perfectly coordinated agents in a simulated toy dataset. Additionally, when modeling the trajectories of professional basketball players, baller2vec outperforms baller2vec by a wide margin.


Potential theory of Dirichlet forms degenerate at the boundary the case of no killing potential. In this paper we consider the Dirichlet form on the half space mathbb R d defined by the jump kernel J(x,y) x y d alpha mathcal B (x,y) , where mathcal B (x,y) can be degenerate at the boundary. Unlike our previous works 6,7 where we imposed critical killing, here we assume that the killing potential is identically zero. In case alpha in (1,2) we first show that the corresponding Hunt process has finite lifetime and dies at the boundary. Then, as our main contribution, we prove the boundary Harnack principle and establish sharp two sided Green function estimates. Our results cover the case of the censored alpha stable process, alpha in (1,2) , in the half space studied in 2 .


On the stability of shear flows of Prandtl type for the steady Navier Stokes equations. In this paper, we prove the stability of shear flows of Prandtl type as big(U(y sqrt nu ),0 big) for the steady Navier Stokes equations under a natural spectral assumption on the linearized NS operator. We develop a direct energy method combined with compact method to solve the Orr Sommerfeld equation.


Tensor diagrams and cluster combinatorics at punctures. Fock and Goncharov introduced a family of cluster algebras associated with the moduli of SL(k) local systems on a marked surface with extra decorations at marked points. We study this family from an algebraic and combinatorial perspective, emphasizing the structures which arise when the surface has punctures. When k is 2, these structures are the tagged arcs and tagged triangulations of Fomin, Shapiro, and Thurston. For higher k, the tagging of arcs is replaced by a Weyl group action at punctures discovered by Goncharov and Shen. We pursue a higher analogue of a tagged triangulation in the language of tensor diagrams, extending work of Fomin and the second author, and we formulate skein algebraic tools for calculating in these cluster algebras. We analyze the finite mutation type examples in detail.


Superconvergence of the Direct Discontinuous Galerkin Method for Two Dimensional Nonlinear Convection Diffusion Equations. This paper is concerned with superconvergence properties of the direct discontinuous Galerkin (DDG) method for two dimensional nonlinear convection diffusion equations. By using the idea of correction function, we prove that, for any piecewise tensor product polynomials of degree k geq 2 , the DDG solution is superconvergent at nodes and Lobatto points, with an order of cal O (h 2k ) and cal O (h k 2 ) , respectively. Moreover, superconvergence properties for the derivative approximation are also studied and the superconvergence points are identified at Gauss points, with an order of cal O (h k 1 ) . Numerical experiments are presented to confirm the sharpness of all the theoretical findings.


Multilingual, Temporal and Sentimental Distant Reading of City Events. Leibniz's Monadology mentions perceptional and sentimental variations of the individual in the city. It is the interaction of people with people and events. Film festivals are highly sentimental events of multicultural cities. Each movie has a different sentimental effect and the interactions with the movies have reflections that can be observed on social media. This analysis aims to apply distant reading on Berlinale tweets collected during the festival. On contrary to close reading, distant reading let authors to observe patterns in large collection of data. The analysis is temporal and sentimental in multilingual domain and strongly positive and negative time intervals are analysed. For this purpose, we trained a deep sentiment network with multilingual embeddings. These multilingual embeddings are aligned in latent space. We trained the network with a multilingual dataset in three languages English, German and Spanish. The trained algorithm has a 0.78 test score and applied on Tweets with Berlinale hashtag during the festival. Although the sentimental analysis does not reflect the award winning films, we observe weekly routine on the relationship between sentimentality, which can mislead a close reading analysis. We have also remarks on popularity of the director or actors.


Reflected BSDEs in non convex domains. This paper establishes the well posedness of reflected backward stochastic differential equations in the non convex domains that satisfy a weaker version of the star shaped property. The main results are established (i) in a Markovian framework with H "older continuous generator and terminal condition and (ii) in a general setting under a smallness assumption on the input data. We also investigate the connections between this well posedness result and the theory of martingales on manifolds.


Trusted Enforcement of Application specific Security Policies. While there have been approaches for integrating security policies into operating systems (OSs) for more than two decades, applications often use objects of higher abstraction requiring individual security policies with application specific semantics. Due to insufficient OS support, current approaches for enforcing application level policies typically lead to large and complex trusted computing bases rendering tamperproofness and correctness difficult to achieve. To mitigate this problem, we propose the application level policy enforcement architecture AppSPEAR and a C framework for its implementation. The configurable framework enables developers to balance enforcement rigor and costs imposed by different implementation alternatives and thus to easily tailor an AppSPEAR implementation to individual application requirements. We especially argue that hardware based trusted execution environments offer an optimal balance between effectiveness and efficiency of policy protection and enforcement. This claim is substantiated by a practical evaluation based on an electronic medical record system.


A Novel Solution of an Elastic Net Regularization for Dementia Knowledge Discovery using Deep Learning. Background and Aim Accurate classification of Magnetic Resonance Images (MRI) is essential to accurately predict Mild Cognitive Impairment (MCI) to Alzheimer's Disease (AD) conversion. Meanwhile, deep learning has been successfully implemented to classify and predict dementia disease. However, the accuracy of MRI image classification is low. This paper aims to increase the accuracy and reduce the processing time of classification through Deep Learning Architecture by using Elastic Net Regularization in Feature Selection. Methodology The proposed system consists of Convolutional Neural Network (CNN) to enhance the accuracy of classification and prediction by using Elastic Net Regularization. Initially, the MRI images are fed into CNN for features extraction through convolutional layers alternate with pooling layers, and then through a fully connected layer. After that, the features extracted are subjected to Principle Component Analysis (PCA) and Elastic Net Regularization for feature selection. Finally, the selected features are used as an input to Extreme Machine Learning (EML) for the classification of MRI images. Results The result shows that the accuracy of the proposed solution is better than the current system. In addition to that, the proposed method has improved the classification accuracy by 5 on average and reduced the processing time by 30 40 seconds on average. Conclusion The proposed system is focused on improving the accuracy and processing time of MCI converters non converters classification. It consists of features extraction, feature selection, and classification using CNN, FreeSurfer, PCA, Elastic Net, Extreme Machine Learning. Finally, this study enhances the accuracy and the processing time by using Elastic Net Regularization, which provides important selected features for classification.


Multiple point residue formulas for holomorphic maps. We develop a new approach to the study of the multipoint loci of holomorphic maps between complex manifolds. We relate the k fold locus to the curvilinear component of the Hilbert scheme of k points on the source space of the map, and using equivariant localisation, we derive a closed iterated multipoint residue formula. Our work is motivated by ideas and conjectures of M. Kazarian and R. Rim 'anyi on residual polynomials.


Post Quantum Cryptography Readiness Challenges and the Approaching Storm. While advances in quantum computing promise new opportunities for scientific advancement (e.g., material science and machine learning), many people are not aware that they also threaten the widely deployed cryptographic algorithms that are the foundation of today's digital security and privacy. From mobile communications to online banking to personal data privacy, literally billions of Internet users rely on cryptography every day to ensure that private communications and data stay private. Indeed, the emergence and growth of the public Internet and electronic commerce was arguably enabled by the invention of public key cryptography. The key advantage offered by public key cryptography is that it allows two parties who have never communicated previously to nevertheless establish a secure, private, communication channel over a non private network (e.g., the Internet). Recent advances in quantum computing signal that we are on the cusp of our next cryptographic algorithm transition, and this transition to post quantum cryptography will be more complicated and impact many more systems and stakeholders, than any of the prior migrations. This transition represents a major disruption within the IT industry and will broadly impact nearly every domain of our digital lives, from global commerce to social media to government and more. Cryptographic algorithm transitions take time and involve an extensive coordination effort across many stakeholders who are involved in building and operating the world's compute infrastructure. By preparing now for the upcoming transition to these new algorithms, we can ensure a more orderly, less costly, and minimally disruptive changeover.


Identity Concealment Games How I Learned to Stop Revealing and Love the Coincidences. In an adversarial environment, a hostile player performing a task may behave like a non hostile one in order not to reveal its identity to an opponent. To model such a scenario, we define identity concealment games zero sum stochastic reachability games with a zero sum objective of identity concealment. To measure the identity concealment of the player, we introduce the notion of an average player. The average player's policy represents the expected behavior of a non hostile player. We show that there exists an equilibrium policy pair for every identity concealment game and give the optimality equations to synthesize an equilibrium policy pair. If the player's opponent follows a non equilibrium policy, the player can hide its identity better. For this reason, we study how the hostile player may learn the opponent's policy. Since learning via exploration policies would quickly reveal the hostile player's identity to the opponent, we consider the problem of learning a near optimal policy for the hostile player using the game runs collected under the average player's policy. Consequently, we propose an algorithm that provably learns a near optimal policy and give an upper bound on the number of sample runs to be collected.


Ginzburg algebras of triangulated surfaces and perverse schobers. Ginzburg algebras associated to triangulated surfaces provide a means to categorify the cluster algebras of these surfaces. As shown by Ivan Smith, the finite derived category of such a Ginzburg algebra can be embedded into the Fukaya category of the total space of a Lefschetz fibration over the surface. Inspired by this perspective, we provide a description of the full derived category in terms of a perverse schober. The main novelty is a gluing formalism describing the Ginzburg algebra as a colimit of certain local Ginzburg algebras associated to discs. As a first application, we give a new proof of the derived invariance of these Ginzburg algebras under flips of an edge of the triangulation. Finally, we note that the perverse schober as well as the resulting gluing construction can also be defined over the sphere spectrum.


Counting Parabolic Principal G bundles with Nilpotent Endomorphisms over mathbb P 1 . Let G be a split connected reductive group over mathbb F q and let mathbb P 1 be the projective line over mathbb F q . Firstly, we give an explicit formula for the number of mathbb F q rational points of generalized Steinberg varieties of G . Secondly, for each principal G bundle over mathbb P 1 , we give an explicit formula counting the number of triples consisting of parabolic structures at 0 and infty and a compatible nilpotent section of the associated adjoint bundle. In the case of GL n we calculate a generating function of such volumes re deriving a result of Mellit.


Fruit Diophantine Equation. We show that the Diophantine equation given by X 3 XYZ Y 2 Z 2 5 has no integral solution. As a consequence, we show that the family of elliptic curve given by the Weierstrass equations Y 2 kXY X 3 (k 2 5) has no integral point.


Smart Speakers, the Next Frontier in Computational Health. The rapid dissemination and adoption of smart speakers has enabled substantial opportunities to improve human health. Just as the introduction of the mobile phone led to considerable health innovation, smart speaker computing systems carry several unique advantages that have the potential to catalyze new fields of health research, particularly in out of hospital environments. The recent rise and ubiquity of these smart computing systems hold significant potential for enhancing chronic disease management, enabling passive identification of unwitnessed medical emergencies, detecting subtle changes in human behavior and cognition, limiting isolation, and potentially allowing widespread, passive, remote monitoring of respiratory diseases that impact the public health. There are 3 broad mechanisms for how a smart speaker can interact with a person to improve health. These include (i) as an intelligent conversational agent, (ii) a passive identifier of medically relevant diagnostic sounds and (iii) active sensing using the device's internal hardware to measure physiologic parameters, such as with active sonar, radar or computer vision. Each of these different modalities have specific clinical use cases, all of which need to be balanced against potential privacy concerns, equity related to system access and regulatory frameworks which have not yet been developed for this unique type of passive data collection.


Robot Assisted Surgical Training Over Several Days in a Virtual Surgical Environment with Divergent and Convergent Force Fields. Surgical procedures require a high level of technical skill to ensure efficiency and patient safety. Due to the direct effect of surgeon skill on patient outcomes, the development of cost effective and realistic training methods is imperative to accelerate skill acquisition. Teleoperated robotic devices allow for intuitive ergonomic control, but the learning curve for these systems remains steep. Recent studies in motor learning have shown that visual or physical exaggeration of errors helps trainees to learn to perform tasks faster and more accurately. In this study, we extended the work from two previous studies to investigate the performance of subjects in different force field training conditions, including convergent (assistive), divergent (resistive), and no force field (null).


ECKPN Explicit Class Knowledge Propagation Network for Transductive Few shot Learning. Recently, the transductive graph based methods have achieved great success in the few shot classification task. However, most existing methods ignore exploring the class level knowledge that can be easily learned by humans from just a handful of samples. In this paper, we propose an Explicit Class Knowledge Propagation Network (ECKPN), which is composed of the comparison, squeeze and calibration modules, to address this problem. Specifically, we first employ the comparison module to explore the pairwise sample relations to learn rich sample representations in the instance level graph. Then, we squeeze the instance level graph to generate the class level graph, which can help obtain the class level visual knowledge and facilitate modeling the relations of different classes. Next, the calibration module is adopted to characterize the relations of the classes explicitly to obtain the more discriminative class level knowledge representations. Finally, we combine the class level knowledge with the instance level sample representations to guide the inference of the query samples. We conduct extensive experiments on four few shot classification benchmarks, and the experimental results show that the proposed ECKPN significantly outperforms the state of the art methods.


A Spectral Spatial Dependent Global Learning Framework for Insufficient and Imbalanced Hyperspectral Image Classification. Deep learning techniques have been widely applied to hyperspectral image (HSI) classification and have achieved great success. However, the deep neural network model has a large parameter space and requires a large number of labeled data. Deep learning methods for HSI classification usually follow a patchwise learning framework. Recently, a fast patch free global learning (FPGA) architecture was proposed for HSI classification according to global spatial context information. However, FPGA has difficulty extracting the most discriminative features when the sample data is imbalanced. In this paper, a spectral spatial dependent global learning (SSDGL) framework based on global convolutional long short term memory (GCL) and global joint attention mechanism (GJAM) is proposed for insufficient and imbalanced HSI classification. In SSDGL, the hierarchically balanced (H B) sampling strategy and the weighted softmax loss are proposed to address the imbalanced sample problem. To effectively distinguish similar spectral characteristics of land cover types, the GCL module is introduced to extract the long short term dependency of spectral features. To learn the most discriminative feature representations, the GJAM module is proposed to extract attention areas. The experimental results obtained with three public HSI datasets show that the SSDGL has powerful performance in insufficient and imbalanced sample problems and is superior to other state of the art methods. Code can be obtained at https github.com dengweihuan SSDGL.


From loom spaces to veering triangulations. We introduce loom spaces, a generalisation of both the leaf spaces associated to pseudo Anosov flows and the link spaces associated to veering triangulations. Following work of Gu 'eritaud, we prove that there is a locally veering triangulation canonically associated to every loom space, and that the realisation of this triangulation is homeomorphic to mathbb R 3 .


Lorentz and Gale Ryser theorems on general measure spaces. Based on the Gale Ryser theorem for the existence of suitable (0,1) matrices for different partitions of a natural number, we revisit the classical result of G. G. Lorentz regarding the characterization of a plane measurable set, in terms of its cross sections, and extend it to general measure spaces.


Taming Sparsely Activated Transformer with Stochastic Experts. Sparsely activated models (SAMs), such as Mixture of Experts (MoE), can easily scale to have outrageously large amounts of parameters without significant increase in computational cost. However, SAMs are reported to be parameter inefficient such that larger models do not always lead to better performance. While most on going research focuses on improving SAMs models by exploring methods of routing inputs to experts, our analysis reveals that such research might not lead to the solution we expect, i.e., the commonly used routing methods based on gating mechanisms do not work better than randomly routing inputs to experts. In this paper, we propose a new expert based model, THOR (Transformer witH StOchastic ExpeRts). Unlike classic expert based models, such as the Switch Transformer, experts in THOR are randomly activated for each input during training and inference. THOR models are trained using a consistency regularized loss, where experts learn not only from training data but also from other experts as teachers, such that all the experts make consistent predictions. We validate the effectiveness of THOR on machine translation tasks. Results show that THOR models are more parameter efficient in that they significantly outperform the Transformer and MoE models across various settings. For example, in multilingual translation, THOR outperforms the Switch Transformer by 2 BLEU scores, and obtains the same BLEU score as that of a state of the art MoE model that is 18 times larger. Our code is publicly available at https github.com microsoft Stochastic Mixture of Experts.


Aristotle Said "Happiness is a State of Activity" Predicting Mood through Body Sensing with Smartwatches. We measure and predict states of Activation and Happiness using a body sensing application connected to smartwatches. Through the sensors of commercially available smartwatches we collect individual mood states and correlate them with body sensing data such as acceleration, heart rate, light level data, and location, through the GPS sensor built into the smartphone connected to the smartwatch. We polled users on the smartwatch for seven weeks four times per day asking for their mood state. We found that both Happiness and Activation are negatively correlated with heart beats and with the levels of light. People tend to be happier when they are moving more intensely and are feeling less activated during weekends. We also found that people with a lower Conscientiousness and Neuroticism and higher Agreeableness tend to be happy more frequently. In addition, more Activation can be predicted by lower Openness to experience and higher Agreeableness and Conscientiousness. Lastly, we find that tracking people's geographical coordinates might play an important role in predicting Happiness and Activation. The methodology we propose is a first step towards building an automated mood tracking system, to be used for better teamwork and in combination with social network analysis studies.


Read, Attend, and Code Pushing the Limits of Medical Codes Prediction from Clinical Notes by Machines. Prediction of medical codes from clinical notes is both a practical and essential need for every healthcare delivery organization within current medical systems. Automating annotation will save significant time and excessive effort spent by human coders today. However, the biggest challenge is directly identifying appropriate medical codes out of several thousands of high dimensional codes from unstructured free text clinical notes. In the past three years, with Convolutional Neural Networks (CNN) and Long Short Term Memory (LTSM) networks, there have been vast improvements in tackling the most challenging benchmark of the MIMIC III full label inpatient clinical notes dataset. This progress raises the fundamental question of how far automated machine learning (ML) systems are from human coders' working performance. We assessed the baseline of human coders' performance on the same subsampled testing set. We also present our Read, Attend, and Code (RAC) model for learning the medical code assignment mappings. By connecting convolved embeddings with self attention and code title guided attention modules, combined with sentence permutation based data augmentations and stochastic weight averaging training, RAC establishes a new state of the art (SOTA), considerably outperforming the current best Macro F1 by 18.7 , and reaches past the human level coding baseline. This new milestone marks a meaningful step toward fully autonomous medical coding (AMC) in machines reaching parity with human coders' performance in medical code prediction.


Autonomous Navigation of an Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learning. Autonomous ultrasound (US) acquisition is an important yet challenging task, as it involves interpretation of the highly complex and variable images and their spatial relationships. In this work, we propose a deep reinforcement learning framework to autonomously control the 6 D pose of a virtual US probe based on real time image feedback to navigate towards the standard scan planes under the restrictions in real world US scans. Furthermore, we propose a confidence based approach to encode the optimization of image quality in the learning process. We validate our method in a simulation environment built with real world data collected in the US imaging of the spine. Experimental results demonstrate that our method can perform reproducible US probe navigation towards the standard scan plane with an accuracy of 4.91mm 4.65 circ in the intra patient setting, and accomplish the task in the intra and inter patient settings with a success rate of 92 and 46 , respectively. The results also show that the introduction of image quality optimization in our method can effectively improve the navigation performance.


Rethinking Crowd Sourcing for Semantic Similarity. Estimation of semantic similarity is crucial for a variety of natural language processing (NLP) tasks. In the absence of a general theory of semantic information, many papers rely on human annotators as the source of ground truth for semantic similarity estimation. This paper investigates the ambiguities inherent in crowd sourced semantic labeling. It shows that annotators that treat semantic similarity as a binary category (two sentences are either similar or not similar and there is no middle ground) play the most important role in the labeling. The paper offers heuristics to filter out unreliable annotators and stimulates further discussions on human perception of semantic similarity.


A class of ENO schemes with adaptive order for solving hyperbolic conservation laws. We propose a class of essentially non oscillatory schemes with adaptive order (ENO AO) for solving hyperbolic conservation laws. The new schemes select candidate stencils by novel smoothness indicators which are the measurements of the minimum discrepancy between the reconstructed polynomials and the neighboring cell averages. The new smoothness indicators measure the smoothness of candidate stencils with unequal sizes in a uniform way, so that we can directly use them to select the optimal stencil from candidates that range from first order all the way up to the designed high order. Some benchmark test cases are carried out to demonstrate the accuracy and robustness of the proposed schemes.


Right fractional Sobolev space via Riemann Liouville derivatives on time scales and an application to fractional boundary value problem on time scales. Using the concept of fractional derivatives of Riemann Liouville on time scales, we first introduce right fractional Sobolev spaces and characterize them. Then, we prove the equivalence of some norms in the introduced spaces, and obtain their completeness, reflexivity, separability and some imbeddings. Finally, as an application, we propose a recent method to study the existence of weak solutions of fractional boundary value problems on time scales by using variational method and critical point theory, and by constructing an appropriate variational setting, we obtain two existence results of the problem.


Local and 2 local automorphisms of some solvable Leibniz algebras. In this paper we prove that any local automorphism on the solvable Leibniz algebras with null filiform and naturally graded non Lie filiform nilradicals, whose dimension of complementary space is maximal is an automorphism. Furthermore, the same problem concerning 2 local automorphisms of such algebras is investigated and we obtain the analogously results for 2 local automorphisms.


A Survey on Gender Bias in Natural Language Processing. Language can be used as a means of reproducing and enforcing harmful stereotypes and biases and has been analysed as such in numerous research. In this paper, we present a survey of 304 papers on gender bias in natural language processing. We analyse definitions of gender and its categories within social sciences and connect them to formal definitions of gender bias in NLP research. We survey lexica and datasets applied in research on gender bias and then compare and contrast approaches to detecting and mitigating gender bias. We find that research on gender bias suffers from four core limitations. 1) Most research treats gender as a binary variable neglecting its fluidity and continuity. 2) Most of the work has been conducted in monolingual setups for English or other high resource languages. 3) Despite a myriad of papers on gender bias in NLP methods, we find that most of the newly developed algorithms do not test their models for bias and disregard possible ethical considerations of their work. 4) Finally, methodologies developed in this line of research are fundamentally flawed covering very limited definitions of gender bias and lacking evaluation baselines and pipelines. We suggest recommendations towards overcoming these limitations as a guide for future research.


FlexParser the adaptive log file parser for continuous results in a changing world. Any modern system writes events into files, called log files. Those contain crucial information which are subject to various analyses. Examples range from cybersecurity, intrusion detection over usage analyses to trouble shooting. Before data analysis is possible, desired information needs to be extracted first out of the semi structured log messages. State of the art event parsing often assumes static log events. However, any modern system is updated consistently and with updates also log file structures can change. We call those changes "mutation" and study parsing performance for different mutation cases. Latest research discovers mutations using anomaly detection post mortem, however, does not cover actual continuous parsing. Thus, we propose a novel and flexible parser, called FlexParser, which can extract desired values despite gradual changes in the log messages. It implies basic text preprocessing followed by a supervised Deep Learning method. We train a stateful LSTM on parsing one event per data set. Statefulness enforces the model to learn log message structures across several examples. Our model was tested on seven different, publicly available log file data sets and various kinds of mutations. Exhibiting an average F1 Score of 0.98, it outperforms other Deep Learning methods as well as state of the art unsupervised parsers.


wo In One A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement. Virtual Reality (VR) applications often require users to perform actions with two hands when performing tasks and interacting with objects in virtual environments. Although bimanual interactions in VR can resemble real world interactions thus increasing realism and improving immersion they can also pose significant accessibility challenges to people with limited mobility, such as for people who have full use of only one hand. An opportunity exists to create accessible techniques that take advantage of users' abilities, but designers currently lack structured tools to consider alternative approaches. To begin filling this gap, we propose Two in One, a design space that facilitates the creation of accessible methods for bimanual interactions in VR from unimanual input. Our design space comprises two dimensions, bimanual interactions and computer assistance, and we provide a detailed examination of issues to consider when creating new unimanual input techniques that map to bimanual interactions in VR. We used our design space to create three interaction techniques that we subsequently implemented for a subset of bimanual interactions and received user feedback through a video elicitation study with 17 people with limited mobility. Our findings explore complex tradeoffs associated with autonomy and agency and highlight the need for additional settings and methods to make VR accessible to people with limited mobility.


Multiple generalized cluster structures on D( text GL n) . We produce a large class of generalized cluster structures on the Drinfeld double of text GL n that are compatible with Poisson brackets given by Belavin Drinfeld classification. The resulting construction is compatible with the previous results on cluster structures on text GL n .


Tilings of the sphere by congruent quadrilaterals with 3 distinct edge lengths. We develop the basic tools for classifying edge to edge tilings of the sphere by congruent quadrilaterals. Then we classify the case with 3 distinct edge lengths such tilings are a sequence of two parameter families of 2 layer earth map tilings with 2n (n 3) tiles, a one parameter family of quadrilateral subdivisions of the octahedron with 24 tiles together with a flip modification in one special case, and a sequence of 3 layer earth map tilings with 8n (n 2) tiles together with two flip modifications when n is odd. We also describe the moduli and calculate the geometric data.


Structural properties of Toeplitz graphs. In this paper, we study structural properties of Toeplitz graphs. We characterize K q free Toeplitz graphs for an integer q ge 3 and give equivalent conditions for a Toeplitz graph G n langle t 1, t 2, ldots, t k rangle with t 1 cdots t k and n ge t k 1 t k being chordal and equivalent conditions for a Toeplitz graph G n langle t 1,t 2 rangle being perfect. Then we compute the edge clique cover number and the vertex clique cover number of a chordal Toeplitz graph. Finally, we characterize the degree sequence (d 1,d 2, ldots,d n) of a Toeplitz graph with n vertices and show that a Toeplitz graph is a regular graph if and only if it is a circulant graph.


Como o Game Design Pode Incentivar o Comportamento T 'oxico em Jogos Online. Toxic behavior is one of the problems most associated with the gaming community. Reports of hate speech and anti gaming behavior are common in many online multiplayer games. Many studies address this area, focusing on players and, principally, on the content and its negative impact on the community. However, it is possible that other factors influence the toxicity. In this article, we investigate how game design elements influence toxic behavior, using toxic disinhibition factors as a basis for the analysis. For this, four of the main games of the MOBA genre were analyzed with the support of the MDA Framework and a questionnaire with players. The results show that most players suffered offenses and offended other people in the game, in addition to recognizing MOBA as the genre that generates the most impatience among them. Furthermore, we raise and discuss different elements and mechanics in games that impact the well being of the community through the individualization of the player, elimination of solidarities, and affirmation of indifference towards toxic behavior. With this, we hope to help game developers and communities to promote integration dynamics.


Revisiting the Characteristics of Stochastic Gradient Noise and Dynamics. In this paper, we characterize the noise of stochastic gradients and analyze the noise induced dynamics during training deep neural networks by gradient based optimizers. Specifically, we firstly show that the stochastic gradient noise possesses finite variance, and therefore the classical Central Limit Theorem (CLT) applies this indicates that the gradient noise is asymptotically Gaussian. Such an asymptotic result validates the wide accepted assumption of Gaussian noise. We clarify that the recently observed phenomenon of heavy tails within gradient noise may not be intrinsic properties, but the consequence of insufficient mini batch size the gradient noise, which is a sum of limited i.i.d. random variables, has not reached the asymptotic regime of CLT, thus deviates from Gaussian. We quantitatively measure the goodness of Gaussian approximation of the noise, which supports our conclusion. Secondly, we analyze the noise induced dynamics of stochastic gradient descent using the Langevin equation, granting for momentum hyperparameter in the optimizer with a physical interpretation. We then proceed to demonstrate the existence of the steady state distribution of stochastic gradient descent and approximate the distribution at a small learning rate.


Multiple Meta model Quantifying for Medical Visual Question Answering. Transfer learning is an important step to extract meaningful features and overcome the data limitation in the medical Visual Question Answering (VQA) task. However, most of the existing medical VQA methods rely on external data for transfer learning, while the meta data within the dataset is not fully utilized. In this paper, we present a new multiple meta model quantifying method that effectively learns meta annotation and leverages meaningful features to the medical VQA task. Our proposed method is designed to increase meta data by auto annotation, deal with noisy labels, and output meta models which provide robust features for medical VQA tasks. Extensively experimental results on two public medical VQA datasets show that our approach achieves superior accuracy in comparison with other state of the art methods, while does not require external data to train meta models.


Split 3 Lie Rinehart color algebras. In this paper we introduce a class of 3 color algebras which are called split 3 Lie Rinehart color algebras as the natural generalization of the one of split LieRinehart algebras. We characterize their inner structures by developing techniques of connections of root systems and weight systems associated to a splitting Cartan subalgebra. We show that such a tight split 3 Lie Rinehart color algebras ( LL, A) decompose as the orthogonal direct sums LL oplus i in I LL i and A oplus j in J A j, where any LL i is a non zero graded ideal of LL satisfying LL i 1 , LL i 2 , LL i 3 0 if i 1, i 2, i 3 in I be different from each other and any A j is a non zero graded ideal of A satisfying A j 1 A j 2 0 if J 1 neq j 2. Both decompositions satisfy that for any i in I there exists a unique j in J such that A j LL i 0 . Furthermore, any ( LL i , A j ) is a split 3 LieRinehart color algebra. Also, under certain conditions, it is shown that the above decompositions of LL and A are by means of the family of their, respective, simple ideals.


Unsupervised Person Re identification via Simultaneous Clustering and Consistency Learning. Unsupervised person re identification (re ID) has become an important topic due to its potential to resolve the scalability problem of supervised re ID models. However, existing methods simply utilize pseudo labels from clustering for supervision and thus have not yet fully explored the semantic information in data itself, which limits representation capabilities of learned models. To address this problem, we design a pretext task for unsupervised re ID by learning visual consistency from still images and temporal consistency during training process, such that the clustering network can separate the images into semantic clusters automatically. Specifically, the pretext task learns semantically meaningful representations by maximizing the agreement between two encoded views of the same image via a consistency loss in latent space. Meanwhile, we optimize the model by grouping the two encoded views into same cluster, thus enhancing the visual consistency between views. Experiments on Market 1501, DukeMTMC reID and MSMT17 datasets demonstrate that our proposed approach outperforms the state of the art methods by large margins.


Demystifying Memory Access Patterns of FPGA Based Graph Processing Accelerators. Recent advances in reprogrammable hardware (e.g., FPGAs) and memory technology (e.g., DDR4, HBM) promise to solve performance problems inherent to graph processing like irregular memory access patterns on traditional hardware (e.g., CPU). While several of these graph accelerators were proposed in recent years, it remains difficult to assess their performance and compare them on common graph workloads and accelerator platforms, due to few open source implementations and excessive implementation effort. In this work, we build on a simulation environment for graph processing accelerators, to make several existing accelerator approaches comparable. This allows us to study relevant performance dimensions such as partitioning schemes and memory technology, among others. The evaluation yields insights into the strengths and weaknesses of current graph processing accelerators along these dimensions, and features a novel in depth comparison.


Multi Scale High Resolution Vision Transformer for Semantic Segmentation. Vision Transformers (ViTs) have emerged with superior performance on computer vision tasks compared to convolutional neural network (CNN) based models. However, ViTs are mainly designed for image classification that generate single scale low resolution representations, which makes dense prediction tasks such as semantic segmentation challenging for ViTs. Therefore, we propose HRViT, which enhances ViTs to learn semantically rich and spatially precise multi scale representations by integrating high resolution multi branch architectures with ViTs. We balance the model performance and efficiency of HRViT by various branch block co optimization techniques. Specifically, we explore heterogeneous branch designs, reduce the redundancy in linear layers, and augment the attention block with enhanced expressiveness. Those approaches enabled HRViT to push the Pareto frontier of performance and efficiency on semantic segmentation to a new level, as our evaluation results on ADE20K and Cityscapes show. HRViT achieves 50.20 mIoU on ADE20K and 83.16 mIoU on Cityscapes, surpassing state of the art MiT and CSWin backbones with an average of 1.78 mIoU improvement, 28 parameter saving, and 21 FLOPs reduction, demonstrating the potential of HRViT as a strong vision backbone for semantic segmentation.


MemBERT Injecting Unstructured Knowledge into BERT. Transformers changed modern NLP in many ways. However, they can hardly exploit domain knowledge, and like other blackbox models, they lack interpretability. Unfortunately, structured knowledge injection, in the long run, risks to suffer from a knowledge acquisition bottleneck. We thus propose a memory enhancement of transformer models that makes use of unstructured domain knowledge expressed in plain natural language. An experimental evaluation conducted on two challenging NLP tasks demonstrates that our approach yields better performance and model interpretability than baseline transformer based architectures.


If You Must Choose Among Your Children, Pick the Right One. Given a simplicial complex K and an injective function f from the vertices of K to mathbb R , we consider algorithms that extend f to a discrete Morse function on K . We show that an algorithm of King, Knudson and Mramor can be described on the directed Hasse diagram of K . Our description has a faster runtime for high dimensional data with no increase in space.


OCTOPUS Overcoming Performance andPrivatization Bottlenecks in Distributed Learning. The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to collaboratively learn a commonly shared model while holding data locally. However, it is also faced with expensive communication and limitations due to the heterogeneity of distributed data sources and lack of access to global data. In this paper, we investigate a practical distributed learning scenario where multiple downstream tasks (e.g., classifiers) could be efficiently learned from dynamically updated and non iid distributed data sources while providing local data privatization. We introduce a new distributed collaborative learning scheme to address communication overhead via latent compression, leveraging global data while providing privatization of local data without additional cost due to encryption or perturbation. This scheme divides learning into (1) informative feature encoding, and transmitting the latent representation of local data to address communication overhead (2) downstream tasks centralized at the server using the encoded codes gathered from each node to address computing overhead. Besides, a disentanglement strategy is applied to address the privatization of sensitive components of local data. Extensive experiments are conducted on image and speech datasets. The results demonstrate that downstream tasks on the compact latent representations with the privatization of local data can achieve comparable accuracy to centralized learning.


Different Impact of Heart Rate Variability in the Deep Cerebral and Central Hemodynamics at Rest An in silico Investigation. Heart rate variability (HRV), defined as the variability between consecutive heartbeats, is a surrogate measure of cardiac vagal tone. It is widely accepted that a decreased HRV is associated to several risk factors and cardiovascular diseases. However, a possible association between HRV and altered cerebral hemodynamics is still debated, suffering from HRV short term measures and the paucity of high resolution deep cerebral data. We propose a computational approach to evaluate the deep cerebral and central hemodynamics subject to physiological alterations of HRV in an ideal young healthy patient at rest. The cardiovascular cerebral model was validated and recently exploited to understand the hemodynamic mechanisms between cardiac arrythmia and cognitive deficit. Three configurations (baseline, increased HRV, and decreased HRV) are built based on the standard deviation (SDNN) of RR beats. In the cerebral circulation, our results show that HRV has overall a stronger impact on pressure than flow rate mean values but similarly alters pressure and flow rate in terms of extreme events. By comparing reduced and increased HRV, this latter induces a higher probability of altered mean and extreme values, and is therefore more detrimental at distal cerebral level. On the contrary, at central level a decreased HRV induces a higher cardiac effort without improving the mechano contractile performance, thus overall reducing the heart efficiency. Present results suggest that (i) the increase of HRV per se does not seem to be sufficient to trigger a better cerebral hemodynamic response (ii) by accounting for both central and cerebral circulations, the optimal HRV configuration is found at baseline. Given the relation inversely linking HRV and HR, the presence of this optimal condition can contribute to explain why the mean HR of the general population settles around the baseline value (70 bpm).


Technical Report Temporal Aggregate Representations. This technical report extends our work presented in 9 with more experiments. In 9 , we tackle long term video understanding, which requires reasoning from current and past or future observations and raises several fundamental questions. How should temporal or sequential relationships be modelled? What temporal extent of information and context needs to be processed? At what temporal scale should they be derived? 9 addresses these questions with a flexible multi granular temporal aggregation framework. In this report, we conduct further experiments with this framework on different tasks and a new dataset, EPIC KITCHENS 100.


Diverse Adversaries for Mitigating Bias in Training. Adversarial learning can learn fairer and less biased models of language than standard methods. However, current adversarial techniques only partially mitigate model bias, added to which their training procedures are often unstable. In this paper, we propose a novel approach to adversarial learning based on the use of multiple diverse discriminators, whereby discriminators are encouraged to learn orthogonal hidden representations from one another. Experimental results show that our method substantially improves over standard adversarial removal methods, in terms of reducing bias and the stability of training.


Connective Models for Topological Modular Forms of Level n . The goal of this article is to construct and study connective versions of topological modular forms of higher level like mathrm tmf 1(n) . In particular, we use them to realize Hirzebruch's level n genus as a map of ring spectra.


On the performance of GPU accelerated q LSKUM based meshfree solvers in Fortran, C , Python, and Julia. This report presents a comprehensive analysis of the performance of GPU accelerated meshfree CFD solvers for two dimensional compressible flows in Fortran, C , Python, and Julia. The programming model CUDA is used to develop the GPU codes. The meshfree solver is based on the least squares kinetic upwind method with entropy variables (q LSKUM). To assess the computational efficiency of the GPU solvers and to compare their relative performance, benchmark calculations are performed on seven levels of point distribution. To analyse the difference in their run times, the computationally intensive kernel is profiled. Various performance metrics are investigated from the profiled data to determine the cause of observed variation in run times. To address some of the performance related issues, various optimisation strategies are employed. The optimised GPU codes are compared with the naive codes, and conclusions are drawn from their performance.


Modeling the dynamics of COVID 19 transmission in India Social Distancing, Regional Spread and Healthcare Capacity. In the new paradigm of health centric governance, policy makers are in a constant need for appropriate metrics and estimates in order to determine the best policies in a non arbitrary fashion. Thus, in this paper, a compartmentalized model for the transmission of COVID 19 is developed to facilitate policy making. A socially distanced compartment is added to the model and its utility in quantifying the magnitude of voluntary social distancing is illustrated. Modifications are made to incorporate inter region migration, and suitable metrics are proposed to quantify the impact of migration on the rise of cases. The healthcare capacity is modeled and a method is developed to study the consequences of the saturation of the healthcare system. The model and related measures are used to study the nature of the transmission and spread of COVID 19 in India, and appropriate insights are drawn.


Covering by planks and avoiding zeros of polynomials. We note that the recent polynomial proofs of the spherical and complex plank covering problems by Zhao and Ortega Moreno give some general information on zeros of real and complex polynomials restricted to the unit sphere. As a corollary of these results, we establish several generalizations of the celebrated Bang plank covering theorem. We prove a tight polynomial analog of the Bang theorem for the Euclidean ball and an even stronger polynomial version for the complex projective space. Specifically, for the ball we show that for every real nonzero d variate polynomial P of degree n , there exists a point in the unit d dimensional ball at distance at least 1 n from the zero set of the polynomial P . Using the polynomial approach, we also prove the strengthening of the Fejes T 'oth zone conjecture on covering a sphere by spherical segments, closed parts of the sphere between two parallel hyperplanes. In particular, we show that the sum of angular widths of spherical segments covering the whole sphere is at least pi .


Memory efficient array redistribution through portable collective communication. Modern large scale deep learning workloads highlight the need for parallel execution across many devices in order to fit model data into hardware accelerator memories. In these settings, array redistribution may be required during a computation, but can also become a bottleneck if not done efficiently. In this paper we address the problem of redistributing multi dimensional array data in SPMD computations, the most prevalent form of parallelism in deep learning. We present a type directed approach to synthesizing array redistributions as sequences of MPI style collective operations. We prove formally that our synthesized redistributions are memory efficient and perform no excessive data transfers. Array redistribution for SPMD computations using collective operations has also been implemented in the context of the XLA SPMD partitioner, a production grade tool for partitioning programs across accelerator systems. We evaluate our approach against the XLA implementation and find that our approach delivers a geometric mean speedup of 1.22 times , with maximum speedups as a high as 5.7 times , while offering provable memory guarantees, making our system particularly appealing for large scale models.


Ensemble neuroevolution based approach for multivariate time series anomaly detection. Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process quite difficult for humans. Algorithms which automates the process of detecting anomalies are crucial in modern failure prevention systems. Therefore, many machine and deep learning models have been designed to address this problem. Mostly, they are autoencoder based architectures with some generative adversarial elements. In this work, a framework is shown which incorporates neuroevolution methods to boost the anomaly detection scores of new and already known models. The presented approach adapts evolution strategies for evolving ensemble model, in which every single model works on a subgroup of data sensors. The next goal of neuroevolution is to optimise architecture and hyperparameters like window size, the number of layers, layer depths, etc. The proposed framework shows that it is possible to boost most of the anomaly detection deep learning models in a reasonable time and a fully automated mode. The tests were run on SWAT and WADI datasets. To our knowledge, this is the first approach in which an ensemble deep learning anomaly detection model is built in a fully automatic way using a neuroevolution strategy.


Democracy and polarization in the National Assembly of the Republic of Korea. The median voter hypothesis predicts convergence of party platforms across a one dimensional political spectrum during majoritarian elections. Assuming that the convergence is reflected in legislative activity, we study the time evolution of political polarization in the National Assembly of the Republic of Korea for the past 70 years. By projecting the correlation of lawmakers onto the first principal axis, we observe a high degree of polarization from the early 1960's to the late 1980's before democratization. As predicted by the hypothesis, it showed a sharp decrease when party politics were revived in 1987. Since then, the political landscape has become more and more multi dimensional under the action of party politics, which invalidates the assumption behind the hypothesis. For comparison, we also analyze co sponsorship in the United States House of Representatives from 1979 to 2020, whose correlation matrix has been constantly high dimensional throughout the observation period. Our analysis suggests a pattern of polarization evolving with democratic development, from which we can argue the power and the limitation of the median voter hypothesis as an explanation of real politics.


RVE CV2X A Scalable Emulation Framework for Real Time Evaluation of CV2X Based Connected Vehicle Applications. Vehicle to Everything (V2X) communication has become an integral component of Intelligent Transportation Systems (ITS) due to its ability to connect vehicles, pedestrians, infrastructure, and create situational awareness among vehicles. Cellular Vehicle to Everything (C V2X), based on 3rd Generation Partnership Project (3GPP) Release 14, is one such communication technology that has recently gained significant attention to cater the needs of V2X communication. However, for a successful deployment of C V2X, it is of paramount significance to thoroughly test the performance of this technology. It is unfeasible to physically conduct a V2X communication experiment to test the performance of C V2X by arranging hundreds of real vehicles and their transceiving on board units. Although multiple simulators based on frameworks such as NS 3, OMNET and OPNET have proven to be reliable and economic alternatives to using real vehicles, all these simulators are time consuming and require several orders of magnitudes longer than the actual simulation time. As opposed to physical field and simulation based testing, network emulators can provide more realistic and repeatable results for testing vehicular communication. This paper proposes a real time, high fidelity, hardware in the loop network emulator (RVE CV2X) based on C V2X mode 4 that can provide scalable, reliable and repeatable testing scenarios for V2X communication. The accuracy of this emulator is verified by comparing it to an already validated C V2X simulator based on the NS 3 framework.


CMA Net A Cascaded Mutual Attention Network for Light Field Salient Object Detection. In the past few years, numerous deep learning methods have been proposed to address the task of segmenting salient objects from RGB images. However, these approaches depending on single modality fail to achieve the state of the art performance on widely used light field salient object detection (SOD) datasets, which collect large scale natural images and provide multiple modalities such as multi view, micro lens images and depth maps. Most recently proposed light field SOD methods have acquired improving detecting accuracy, yet still predict rough objects' structures and perform slow inference speed. To this end, we propose CMA Net, which consists of two novel cascaded mutual attention modules aiming at fusing the high level features from the modalities of all in focus and depth. Our proposed CMA Net outperforms 30 SOD methods on two widely applied light field benchmark datasets. Besides, the proposed CMA Net is able to inference at the speed of 53 fps. Extensive quantitative and qualitative experiments illustrate both the effectiveness and efficiency of our CMA Net.


A dataset of mentorship in science with semantic and demographic estimations. Mentorship in science is crucial for topic choice, career decisions, and the success of mentees and mentors. Typically, researchers who study mentorship use article co authorship and doctoral dissertation datasets. However, available datasets of this type focus on narrow selections of fields and miss out on early career and non publication related interactions. Here, we describe MENTORSHIP, a crowdsourced dataset of 743176 mentorship relationships among 738989 scientists across 112 fields that avoids these shortcomings. We enrich the scientists' profiles with publication data from the Microsoft Academic Graph and "semantic" representations of research using deep learning content analysis. Because gender and race have become critical dimensions when analyzing mentorship and disparities in science, we also provide estimations of these factors. We perform extensive validations of the profile publication matching, semantic content, and demographic inferences. We anticipate this dataset will spur the study of mentorship in science and deepen our understanding of its role in scientists' career outcomes.


Bounds for the extremal eigenvalues of gain Laplacian matrices. A complex unit gain graph ( mathbb T gain graph), Phi (G, varphi) is a graph where the function varphi assigns a unit complex number to each orientation of an edge of G , and its inverse is assigned to the opposite orientation. A mathbb T gain graph Phi is balanced if the product of the edge gains of each cycle (with a fixed orientation) is 1 . Signed graphs are special cases of mathbb T gain graphs. The adjacency matrix of Phi , denoted by mathbf A ( Phi) is defined canonically. The gain Laplacian for Phi is defined as mathbf L ( Phi) mathbf D ( Phi) mathbf A ( Phi) , where mathbf D ( Phi) is the diagonal matrix with diagonal entries are the degrees of the vertices of G . The minimum number of vertices (resp., edges) to be deleted from Phi in order to get a balanced gain graph the frustration number (resp, frustration index). We show that frustration number and frustration index are bounded below by the smallest eigenvalue of mathbf L ( Phi) . We provide several lower and upper bounds for extremal eigenvalues of mathbf L ( Phi) in terms of different graph parameters such as the number of edges, vertex degrees, and average 2 degrees. The signed graphs are particular cases of the mathbb T gain graphs, all the bounds established in paper hold for signed graphs. Most of the bounds established here are new for signed graphs. Finally, we perform comparative analysis for all the obtained bounds in the paper with the state of the art bounds available in the literature for randomly generated Erd H o s Re 'yni graphs. Some of the major highlights of our paper are the gain dependent bounds, limit convergence of the bounds to the extremal eigenvalues, and optimal extremal bounds obtained by posing optimization problems to achieve the best possible bounds.


Fair and Efficient Allocations with Limited Demands. We study the fair division problem of allocating multiple resources among a set of agents with Leontief preferences that are each required to complete a finite amount of work, which we term "limited demands". We examine the behavior of the classic Dominant Resource Fairness (DRF) mechanism in this setting and show it is fair but only weakly Pareto optimal and inefficient in many natural examples. We propose as an alternative the Least Cost Product (LCP) mechanism, a natural adaptation of Maximum Nash Welfare to this setting. We characterize the structure of allocations of the LCP mechanism in this setting, show that it is Pareto efficient, and that it satisfies the relatively weak fairness property of sharing incentives. While we prove it satisfies the stronger fairness property of (expected) envy freeness in some special cases, we provide a counterexample showing it does not do so in general, a striking contrast to the "unreasonable fairness" of Maximum Nash Welfare in other settings. Simulations suggest, however, that these violations of envy freeness are rare in randomly generated examples.


Estimating the damage of railway carriage wheels equipped with disc brakes. The aim of this paper is to estimate the damage of railway carriage wheels caused by lock up braking. First, we investigate the typical characteristics of wheel rail contact including the parameters of contact patch, longitudinal creep and coefficient of adhesion. Then we show the current requirements concerning the wheel slide protection systems and determine the points which should be reviewed. To predict the effect of the sliding phenomenon, material properties are needed, as well. Afterwards, a simplified thermal simulation is built to estimate where martensite formation may occur.


Web based Application for Detecting Indonesian Clickbait Headlines using IndoBERT. With increasing usage of clickbaits in Indonesian Online News, newsworthy articles sometimes get buried among clickbaity news. A reliable and lightweight tool is needed to detect such clickbaits on the go. Leveraging state of the art natural language processing model BERT, a RESTful API based application is developed. This study offloaded the computing resources needed to train the model on the cloud server, while the client side application only needs to send a request to the API and the cloud server will handle the rest. This study proposed the design and developed a web based application to detect clickbait in Indonesian using IndoBERT as a language model. The application usage is discussed and available for public use with a performance of mean ROC AUC of 89 .


To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low Resource NLP. Data hungry deep neural networks have established themselves as the standard for many NLP tasks including the traditional sequence tagging ones. Despite their state of the art performance on high resource languages, they still fall behind of their statistical counter parts in low resource scenarios. One methodology to counter attack this problem is text augmentation, i.e., generating new synthetic training data points from existing data. Although NLP has recently witnessed a load of textual augmentation techniques, the field still lacks a systematic performance analysis on a diverse set of languages and sequence tagging tasks. To fill this gap, we investigate three categories of text augmentation methodologies which perform changes on the syntax (e.g., cropping sub sentences), token (e.g., random word insertion) and character (e.g., character swapping) levels. We systematically compare them on part of speech tagging, dependency parsing and semantic role labeling for a diverse set of language families using various models including the architectures that rely on pretrained multilingual contextualized language models such as mBERT. Augmentation most significantly improves dependency parsing, followed by part of speech tagging and semantic role labeling. We find the experimented techniques to be effective on morphologically rich languages in general rather than analytic languages such as Vietnamese. Our results suggest that the augmentation techniques can further improve over strong baselines based on mBERT. We identify the character level methods as the most consistent performers, while synonym replacement and syntactic augmenters provide inconsistent improvements. Finally, we discuss that the results most heavily depend on the task, language pair, and the model type.


A Simple Standard for Sharing Ontological Mappings (SSSOM). Despite progress in the development of standards for describing and exchanging scientific information, the lack of easy to use standards for mapping between different representations of the same or similar objects in different databases poses a major impediment to data integration and interoperability. Mappings often lack the metadata needed to be correctly interpreted and applied. For example, are two terms equivalent or merely related? Are they narrow or broad matches? Are they associated in some other way? Such relationships between the mapped terms are often not documented, leading to incorrect assumptions and making them hard to use in scenarios that require a high degree of precision (such as diagnostics or risk prediction). Also, the lack of descriptions of how mappings were done makes it hard to combine and reconcile mappings, particularly curated and automated ones. The Simple Standard for Sharing Ontological Mappings (SSSOM) addresses these problems by 1. Introducing a machine readable and extensible vocabulary to describe metadata that makes imprecision, inaccuracy and incompleteness in mappings explicit. 2. Defining an easy to use table based format that can be integrated into existing data science pipelines without the need to parse or query ontologies, and that integrates seamlessly with Linked Data standards. 3. Implementing open and community driven collaborative workflows designed to evolve the standard continuously to address changing requirements and mapping practices. 4. Providing reference tools and software libraries for working with the standard. In this paper, we present the SSSOM standard, describe several use cases, and survey some existing work on standardizing the exchange of mappings, with the goal of making mappings Findable, Accessible, Interoperable, and Reusable (FAIR). The SSSOM specification is at http w3id.org sssom spec.


Collective Information Security in Large Scale Urban Protests the Case of Hong Kong. The Anti Extradition Law Amendment Bill protests in Hong Kong present a rich context for exploring information security practices among protesters due to their large scale urban setting and highly digitalised nature. We conducted in depth, semi structured interviews with 11 participants of these protests. Research findings reveal how protesters favoured Telegram and relied on its security for internal communication and organisation of on the ground collective action were organised in small private groups and large public groups to enable collective action adopted tactics and technologies that enable pseudonymity and developed a variety of strategies to detect compromises and to achieve forms of forward secrecy and post compromise security when group members were (presumed) arrested. We further show how group administrators had assumed the roles of leaders in these 'leaderless' protests and were critical to collective protest efforts.


Lie properties in associative algebras. Let K be a field, then we exhibit two matrices in the full nxn matrix algebra M n (K) which generate M n (K) as a Lie K algebra with the commutator Lie product. We also study Lie centralizers of a not necessarily commutative unitary algebra and obtain results which we hope will eventually be a step in the direction of, firstly, proving that a Lie nilpotent K subspace (or a sub Lie K algebra) of a finite dimensional associative algebra over K of index k (say) generates a Lie nilpotent associative subalgebra of much higher nilpotency index, and secondly, in the light of the sharp upper bound for the maximum (K )dimension of a Lie nilpotent K subalgebra of M n (K) of index k (obtained earlier), finding an upper bound for the maximum dimension of a Lie nilpotent (of index k) sub Lie K algebra of M n (K). Finally, the constructive elementary proof of the Skolem Noether theorem for the matrix algebra M n (K) (appeared in the American Math. Monthly), in conjunction with the well known characteization of Lie automorphisms of M n (K) (if the characteristic of K is different from 2 and 3) in terms of, amongst others, automorphisms and anti automorhisms of M n (K), leads us to a unifying approach to constructively describe automorphisms and anti automorphisms of M n (K).


Lumen A Machine Learning Framework to Expose Influence Cues in Text. Phishing and disinformation are popular social engineering attacks with attackers invariably applying influence cues in texts to make them more appealing to users. We introduce Lumen, a learning based framework that exposes influence cues in text (i) persuasion, (ii) framing, (iii) emotion, (iv) objectivity subjectivity, (v) guilt blame, and (vi) use of emphasis. Lumen was trained with a newly developed dataset of 3K texts comprised of disinformation, phishing, hyperpartisan news, and mainstream news. Evaluation of Lumen in comparison to other learning models showed that Lumen and LSTM presented the best F1 micro score, but Lumen yielded better interpretability. Our results highlight the promise of ML to expose influence cues in text, towards the goal of application in automatic labeling tools to improve the accuracy of human based detection and reduce the likelihood of users falling for deceptive online content.


Back Translated Task Adaptive Pretraining Improving Accuracy and Robustness on Text Classification. Language models (LMs) pretrained on a large text corpus and fine tuned on a downstream text corpus and fine tuned on a downstream task becomes a de facto training strategy for several natural language processing (NLP) tasks. Recently, an adaptive pretraining method retraining the pretrained language model with task relevant data has shown significant performance improvements. However, current adaptive pretraining methods suffer from underfitting on the task distribution owing to a relatively small amount of data to re pretrain the LM. To completely use the concept of adaptive pretraining, we propose a back translated task adaptive pretraining (BT TAPT) method that increases the amount of task specific data for LM re pretraining by augmenting the task data using back translation to generalize the LM to the target task domain. The experimental results show that the proposed BT TAPT yields improved classification accuracy on both low and high resource data and better robustness to noise than the conventional adaptive pretraining method.


MATLAB Simulations of the Helium Liquefier in the FREIA Laboratory. We describe simulations that track a state vector with pressure, temperature, and gas flow through the helium liquefier in the FREIA laboratory. Most components, including threeway heat exchangers, are represented by matrices that allow us to track the state through the system. The only non linear element is the Joule Thomson valve, which is represented by a non linear map for the state variables. Realistic properties for the enthalpy and other thermodynamic quantities are taken into account with the help of the CoolProp library. The resulting system of equations is rapidly solved by iteration and shows good agreement with the observed LHe yield with and without liquid nitrogen pre cooling.


Boundedness and Nuclearity of pseudo differential operators on Homogeneous Trees. Let x be the homogeneous tree of degree q 1 (q geq2) . In this article, we present symbolic criteria for boundedness of pseudo differential operators on homogeneous tree x . A sufficient condition for weak type (p, q) boundedness is also given. We present necessary and sufficient conditions on the symbols sigma such that the corresponding pseudo differential operators T sigma from L p 1 ( x) into L p 2 ( x) to be nuclear for 1 leq p 1, p 2 infty . We show that the adjoint of the nuclear operator from L p 2' ( x) into L p 1' ( x) is again a nuclear operator. Explicit formulas for the symbol of the adjoint and product of the nuclear pseudo differential operators on x are given.


NTIRE 2021 Challenge on Burst Super Resolution Methods and Results. This paper reviews the NTIRE2021 challenge on burst super resolution. Given a RAW noisy burst as input, the task in the challenge was to generate a clean RGB image with 4 times higher resolution. The challenge contained two tracks Track 1 evaluating on synthetically generated data, and Track 2 using real world bursts from mobile camera. In the final testing phase, 6 teams submitted results using a diverse set of solutions. The top performing methods set a new state of the art for the burst super resolution task.


Redycler Daily Outfit Texture Fabrication Appliance Using Re Programmable Dyes. We present a speculative design for a novel appliance for future fabrication in the home to revitalize textiles using re programmable multi color textures. Utilizing colored photochromic dyes activated by ultraviolet (UV) light, we can selectively deactivate hues using complementary colors in visible light to result in the final desired dye pattern. Our proposed appliance would automate this process within a box placed in the bedroom. We envision a future where people are able to transform old apparel into unique and fashionable pieces of clothing. We discuss how the user would interact with the appliance and how this device elongates the life cycle of clothing through modification. We also outline the central issues to integrate such a concept into the home. Finally, we analyze how this device fits into personal modification trends in HCI to show how this device could change existing conceptions around sustainable fashion and personal style.


Curriculum Learning A Survey. Training machine learning models in a meaningful order, from the easy samples to the hard ones, using curriculum learning can provide performance improvements over the standard training approach based on random data shuffling, without any additional computational costs. Curriculum learning strategies have been successfully employed in all areas of machine learning, in a wide range of tasks. However, the necessity of finding a way to rank the samples from easy to hard, as well as the right pacing function for introducing more difficult data can limit the usage of the curriculum approaches. In this survey, we show how these limits have been tackled in the literature, and we present different curriculum learning instantiations for various tasks in machine learning. We construct a multi perspective taxonomy of curriculum learning approaches by hand, considering various classification criteria. We further build a hierarchical tree of curriculum learning methods using an agglomerative clustering algorithm, linking the discovered clusters with our taxonomy. At the end, we provide some interesting directions for future work.


Low Mach number limit for degenerate Navier Stokes equations in presence of strong stratification. In this paper, we investigate the low Mach and low Froude numbers limit for the compressible Navier Stokes equations with degenerate, density dependent, viscosity coefficient, in the strong stratification regime. We consider the case of a general pressure law with singular component close to vacuum, and general ill prepared initial data. We perform our study in the three dimensional periodic domain. We rigorously justify the convergence to the generalised anelastic approximation, which is used extensively to model atmospheric flows.


LCP RIT at SemEval 2021 Task 1 Exploring Linguistic Features for Lexical Complexity Prediction. This paper describes team LCP RIT's submission to the SemEval 2021 Task 1 Lexical Complexity Prediction (LCP). The task organizers provided participants with an augmented version of CompLex (Shardlow et al., 2020), an English multi domain dataset in which words in context were annotated with respect to their complexity using a five point Likert scale. Our system uses logistic regression and a wide range of linguistic features (e.g. psycholinguistic features, n grams, word frequency, POS tags) to predict the complexity of single words in this dataset. We analyze the impact of different linguistic features in the classification performance and we evaluate the results in terms of mean absolute error, mean squared error, Pearson correlation, and Spearman correlation.


Random generation of direct sums of finite non degenerate subspaces. Let V be a d dimensional vector space over a finite field mathbb F equipped with a non degenerate hermitian, alternating, or quadratic form. Suppose mathbb F q 2 if V is hermitian, and mathbb F q otherwise. Given integers e, e' such that e e' leqslant d , we estimate the proportion of pairs (U, U') , where U is a non degenerate e subspace of V and U' is a non degenerate e' subspace of V , such that U cap U' 0 and U oplus U' is non degenerate (the sum U oplus U' is direct and usually not perpendicular). The proportion is shown to be positive and at least 1 c q 0 for some constant c . For example, c 7 4 suffices in both the unitary and symplectic cases. The arguments in the orthogonal case are delicate and assume that dim(U) and dim(U') are even, an assumption relevant for an algorithmic application (which we discuss) for recognising finite classical groups. We also describe how recognising a classical groups G relies on a connection between certain pairs (U,U') of non degenerate subspaces and certain pairs (g,g') in G 2 of group elements where U rm im (g 1) and U' rm im (g' 1) .


PANet Perspective Aware Network with Dynamic Receptive Fields and Self Distilling Supervision for Crowd Counting. Crowd counting aims to learn the crowd density distributions and estimate the number of objects (e.g. persons) in images. The perspective effect, which significantly influences the distribution of data points, plays an important role in crowd counting. In this paper, we propose a novel perspective aware approach called PANet to address the perspective problem. Based on the observation that the size of the objects varies greatly in one image due to the perspective effect, we propose the dynamic receptive fields (DRF) framework. The framework is able to adjust the receptive field by the dilated convolution parameters according to the input image, which helps the model to extract more discriminative features for each local region. Different from most previous works which use Gaussian kernels to generate the density map as the supervised information, we propose the self distilling supervision (SDS) training method. The ground truth density maps are refined from the first training stage and the perspective information is distilled to the model in the second stage. The experimental results on ShanghaiTech Part A and Part B, UCF QNRF, and UCF CC 50 datasets demonstrate that our proposed PANet outperforms the state of the art methods by a large margin.


Percolation for the Gaussian free field on the cable system counterexamples. For massless vertex transitive transient graphs, the percolation phase transition for the level sets of the Gaussian free field on the associated continuous cable system is particularly well understood, and in particular the associated critical parameter widetilde h is always equal to zero. On general transient graphs, two weak conditions on the graph mathcal G are given in arXiv 2101.05800, each of which implies one of the two inequalities widetilde h leq0 and widetilde h geq0. In this article, we give two counterexamples to show that none of these two conditions are necessary, prove that the strict inequality widetilde h 0 is typical on massive graphs with bounded weights, and provide an example of a graph on which widetilde h infty. On the way, we obtain another characterization of random interlacements on massive graphs, as well as an isomorphism between the Gaussian free field and the Doob mathit mathbf h transform of random interlacements, and between the two dimensional pinned free field and random interlacements.


Ancient Indian mathematics needs an honorific place in modern mathematics celebration. In point of fact the Indian tradition in mathematics is long and glorious. It dates back to earliest times, and indeed many of the Indian discoveries from 5000 years ago correspond rather naturally to modern mathematical results.


PRISM A Hierarchical Intrusion Detection Architecture for Large Scale Cyber Networks. The increase in scale of cyber networks and the rise in sophistication of cyber attacks have introduced several challenges in intrusion detection. The primary challenge is the requirement to detect complex multi stage attacks in realtime by processing the immense amount of traffic produced by present day networks. In this paper we present PRISM, a hierarchical intrusion detection architecture that uses a novel attacker behavior model based sampling technique to minimize the realtime traffic processing overhead. PRISM has a unique multi layered architecture that monitors network traffic distributedly to provide efficiency in processing and modularity in design. PRISM employs a Hidden Markov Model based prediction mechanism to identify multi stage attacks and ascertain the attack progression for a proactive response. Furthermore, PRISM introduces a stream management procedure that rectifies the issue of alert reordering when collected from distributed alert reporting systems. To evaluate the performance of PRISM, multiple metrics has been proposed, and various experiments have been conducted on a multi stage attack dataset. The results exhibit up to 7.5x improvement in processing overhead as compared to a standard centralized IDS without the loss of prediction accuracy while demonstrating the ability to predict different attack stages promptly.


An Empirical Study of Ageing in the Cloud. We quantify, over inter continental paths, the ageing of TCP packets, throughput and delay for different TCP congestion control algorithms containing a mix of loss based, delay based and hybrid congestion control algorithms. In comparing these TCP variants to ACP , an improvement over ACP, we shed better light on the ability of ACP to deliver timely updates over fat pipes and long paths. ACP estimates the network conditions on the end to end path and adapts the rate of status updates to minimize age. It achieves similar average age as the best (age wise) performing TCP algorithm but at end to end throughputs that are two orders of magnitude smaller. We also quantify the significant improvements that ACP brings to age control over a shared multiaccess channel.


Autonomous search of an airborne release in urban environments using informed tree planning. The use of autonomous vehicles for chemical source localisation is a key enabling tool for disaster response teams to safely and efficiently deal with chemical emergencies. Whilst much work has been performed on source localisation using autonomous systems, most previous works have assumed an open environment or employed simplistic obstacle avoidance, separate to the estimation procedure. In this paper, we explore the coupling of the path planning task for both source term estimation and obstacle avoidance in a holistic framework. The proposed system intelligently produces potential gas sampling locations based on the current estimation of the wind field and the local map. Then a tree search is performed to generate paths toward the estimated source location that traverse around any obstacles and still allow for exploration of potentially superior sampling locations. The proposed informed tree planning algorithm is then tested against the Entrotaxis technique in a series of high fidelity simulations. The proposed system is found to reduce source position error far more efficiently than Entrotaxis in a feature rich environment, whilst also exhibiting vastly more consistent and robust results.


Predicting market inflation expectations with news topics and sentiment. This study presents a novel approach to incorporating news topics and their associated sentiment into predictions of breakeven inflation rate (BEIR) movements for eight countries with mature bond markets. We calibrate five classes of machine learning models including narrative based features for each country, and find that they generally outperform corresponding benchmarks that do not include such features. We find Logistic Regression and XGBoost classifiers to deliver the best performance across countries. We complement these results with a feature importance analysis, showing that economic and financial topics are the key performance drivers in our predictions, with additional contributions from topics related to health and government. We examine cross country spillover effects of news narrative on BEIR via Graphical Granger Causality and confirm their existence for the US and Germany, while five other countries considered in our study are only influenced by local narrative.