On density of modular points in pseudo deformation rings. Given a continuous, odd, reducible and semi simple 2 dimensional representation bar rho 0 of G mathbb Q ,Np over a finite field of odd characteristic p , we study the relation between the universal deformation ring of the pseudo representation corresponding to bar rho 0 (pseudo deformation ring) and the big p adic Hecke algebra to prove that the maximal reduced quotient of the pseudo deformation ring is isomorphic to the local component of the big p adic Hecke algebra corresponding to bar rho 0 if a certain global Galois cohomology group has dimension 1 . This partially extends the results of B " o ckle to the case of residually reducible representations. We give an application of our main theorem to the structure of Hecke algebras modulo p . As another application of our methods and results, we prove a result about non optimal levels of newforms lifting bar rho 0 in the spirit of Diamond Taylor. This also gives a partial answer to a conjecture of Billerey Menares.


A Phase Transition in Large Network Games. In this paper, we use a model of large random network game where the agents plays selfishly and are affected by their neighbors, to explore the conditions under which the Nash equilibrium (NE) of the game is affected by a perturbation in the network. We use a phase transition phenomenon observed in finite rank deformations of large random matrices, to study how the NE changes on crossing critical threshold points. Our main contribution is as follows when the perturbation strength is greater than a critical point, it impacts the NE of the game, whereas when this perturbation is below this critical point, the NE remains independent of the perturbation parameter. This demonstrates a phase transition in NE which alludes that perturbations can affect the behavior of the society only if their strength is above a critical threshold. We provide numerical examples for this result and present scenarios under which this phenomenon could potentially occur in real world applications.


A further generalisation of bar core partitions. When p and q are coprime odd integers no less than 3, Olsson proved that the q bar core of a p bar core is again a p bar core. We establish a generalisation of this theorem that the p bar weight of the q bar core of a bar partition lambda is at most the p bar weight of lambda . We go on to study the set of bar partitions for which equality holds and show that it is a union of orbits for an action of a Coxeter group of type tilde C tfrac (p 1) 2 times tilde C tfrac (q 1) 2 . We also provide an algorithm for constucting a bar partition in this set with a given p bar core and q bar core.


WideCaps A Wide Attention based Capsule Network for Image Classification. The capsule network is a distinct and promising segment of the neural network family that drew attention due to its unique ability to maintain the equivariance property by preserving the spatial relationship amongst the features. The capsule network has attained unprecedented success over image classification tasks with datasets such as MNIST and affNIST by encoding the characteristic features into the capsules and building the parse tree structure. However, on the datasets involving complex foreground and background regions such as CIFAR 10, the performance of the capsule network is sub optimal due to its naive data routing policy and incompetence towards extracting complex features. This paper proposes a new design strategy for capsule network architecture for efficiently dealing with complex images. The proposed method incorporates wide bottleneck residual modules and the Squeeze and Excitation attention blocks upheld by the modified FM routing algorithm to address the defined problem. A wide bottleneck residual module facilitates extracting complex features followed by the squeeze and excitation attention block to enable channel wise attention by suppressing the trivial features. This setup allows channel inter dependencies at almost no computational cost, thereby enhancing the representation ability of capsules on complex images. We extensively evaluate the performance of the proposed model on three publicly available datasets, namely CIFAR 10, Fashion MNIST, and SVHN, to outperform the top 5 performance on CIFAR 10 and Fashion MNIST with highly competitive performance on the SVHN dataset.


Good Enough Example Extrapolation. This paper asks whether extrapolating the hidden space distribution of text examples from one class onto another is a valid inductive bias for data augmentation. To operationalize this question, I propose a simple data augmentation protocol called "good enough example extrapolation" (GE3). GE3 is lightweight and has no hyperparameters. Applied to three text classification datasets for various data imbalance scenarios, GE3 improves performance more than upsampling and other hidden space data augmentation methods.


On the invariant E(G) for groups of odd order. Let G be a multiplicatively written finite group. We denote by mathsf E(G) the smallest integer t such that every sequence of t elements in G contains a product one subsequence of length G . In 1961, Erd H o s, Ginzburg and Ziv proved that mathsf E(G) leq 2 G 1 for every finite solvable group G and this result is well known as the Erd H o s Ginzburg Ziv Theorem. In 2010, Gao and Li improved this result to mathsf E(G) leq frac 7 G 4 1 and they conjectured that mathsf E(G) leq frac 3 G 2 holds for any finite non cyclic group. In this paper, we confirm the conjecture for all finite non cyclic groups of odd order.


Spindle Techniques for Optimizing Atomic Multicast on RDMA. Leveraging one sided RDMA for applications that replicate small data objects can be surprisingly difficult such uses amplify any protocol overheads. Spindle is a set of optimization techniques for systematically tackling this class of challenges for atomic multicast over RDMA. These include memory polling optimizations using novel sender and receiver batching techniques, null message send logic, and improved multi thread synchronization. We applied Spindle to Derecho, an open source C library for atomic multicast, and obtained significant performance improvements both for the library itself and for an OMG compliant avionics DDS built over Derecho. Derecho's multicast bandwidth utilization for 10KB messages rose from 1GB s to 9.7GB s on a 12.5GB s network, and it became more robust to delays. Interestingly, although some of our techniques employ batching, latency dropped by nearly two orders of magnitude. Spindle optimizations should also be of value in other RDMA applications limited by the speed of coordination.


Neural Architecture Search in operational context a remote sensing case study. Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with care. These architectures are often handcrafted and therefore prone to human biases and sub optimal selection. Neural Architecture Search (NAS) is a framework introduced to mitigate such risks by jointly optimizing the network architectures and its weights. Albeit its novelty, it was applied on complex tasks with significant results e.g. semantic image segmentation. In this technical paper, we aim to evaluate its ability to tackle a challenging operational task semantic segmentation of objects of interest in satellite imagery. Designing a NAS framework is not trivial and has strong dependencies to hardware constraints. We therefore motivate our NAS approach selection and provide corresponding implementation details. We also present novel ideas to carry out other such use case studies.


Are Multilingual Models the Best Choice for Moderately Under resourced Languages? A Comprehensive Assessment for Catalan. Multilingual language models have been a crucial breakthrough as they considerably reduce the need of data for under resourced languages. Nevertheless, the superiority of language specific models has already been proven for languages having access to large amounts of data. In this work, we focus on Catalan with the aim to explore to what extent a medium sized monolingual language model is competitive with state of the art large multilingual models. For this, we (1) build a clean, high quality textual Catalan corpus (CaText), the largest to date (but only a fraction of the usual size of the previous work in monolingual language models), (2) train a Transformer based language model for Catalan (BERTa), and (3) devise a thorough evaluation in a diversity of settings, comprising a complete array of downstream tasks, namely, Part of Speech Tagging, Named Entity Recognition and Classification, Text Classification, Question Answering, and Semantic Textual Similarity, with most of the corresponding datasets being created ex novo. The result is a new benchmark, the Catalan Language Understanding Benchmark (CLUB), which we publish as an open resource, together with the clean textual corpus, the language model, and the cleaning pipeline. Using state of the art multilingual models and a monolingual model trained only on Wikipedia as baselines, we consistently observe the superiority of our model across tasks and settings.


NuCLS A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentation. High resolution mapping of cells and tissue structures provides a foundation for developing interpretable machine learning models for computational pathology. Deep learning algorithms can provide accurate mappings given large numbers of labeled instances for training and validation. Generating adequate volume of quality labels has emerged as a critical barrier in computational pathology given the time and effort required from pathologists. In this paper we describe an approach for engaging crowds of medical students and pathologists that was used to produce a dataset of over 220,000 annotations of cell nuclei in breast cancers. We show how suggested annotations generated by a weak algorithm can improve the accuracy of annotations generated by non experts and can yield useful data for training segmentation algorithms without laborious manual tracing. We systematically examine interrater agreement and describe modifications to the MaskRCNN model to improve cell mapping. We also describe a technique we call Decision Tree Approximation of Learned Embeddings (DTALE) that leverages nucleus segmentations and morphologic features to improve the transparency of nucleus classification models. The annotation data produced in this study are freely available for algorithm development and benchmarking at https sites.google.com view nucls.


Tax Evasion Risk Management Using a Hybrid Unsupervised Outlier Detection Method. Big data methods are becoming an important tool for tax fraud detection around the world. Unsupervised learning approach is the dominant framework due to the lack of label and ground truth in corresponding data sets although these methods suffer from low interpretability. HUNOD, a novel hybrid unsupervised outlier detection method for tax evasion risk management, is presented in this paper. In contrast to previous methods proposed in the literature, the HUNOD method combines two outlier detection approaches based on two different machine learning designs (i.e, clustering and representational learning) to detect and internally validate outliers in a given tax dataset. The HUNOD method allows its users to incorporate relevant domain knowledge into both constituent outlier detection approaches in order to detect outliers relevant for a given economic context. The interpretability of obtained outliers is achieved by training explainable by design surrogate models over results of unsupervised outlier detection methods. The experimental evaluation of the HUNOD method is conducted on two datasets derived from the database on individual personal income tax declarations collected by the Tax Administration of Serbia. The obtained results show that the method indicates between 90 and 98 internally validated outliers depending on the clustering configuration and employed regularization mechanisms for representational learning.


The Overlooked Classifier in Human Object Interaction Recognition. Human Object Interaction (HOI) recognition is challenging due to two factors (1) significant imbalance across classes and (2) requiring multiple labels per image. This paper shows that these two challenges can be effectively addressed by improving the classifier with the backbone architecture untouched. Firstly, we encode the semantic correlation among classes into the classification head by initializing the weights with language embeddings of HOIs. As a result, the performance is boosted significantly, especially for the few shot subset. Secondly, we propose a new loss named LSE Sign to enhance multi label learning on a long tailed dataset. Our simple yet effective method enables detection free HOI classification, outperforming the state of the arts that require object detection and human pose by a clear margin. Moreover, we transfer the classification model to instance level HOI detection by connecting it with an off the shelf object detector. We achieve state of the art without additional fine tuning.


Buildings Classification using Very High Resolution Satellite Imagery. Buildings classification using satellite images is becoming more important for several applications such as damage assessment, resource allocation, and population estimation. We focus, in this work, on buildings damage assessment (BDA) and buildings type classification (BTC) of residential and non residential buildings. We propose to rely solely on RGB satellite images and follow a 2 stage deep learning based approach, where first, buildings' footprints are extracted using a semantic segmentation model, followed by classification of the cropped images. Due to the lack of an appropriate dataset for the residential non residential building classification, we introduce a new dataset of high resolution satellite images. We conduct extensive experiments to select the best hyper parameters, model architecture, and training paradigm, and we propose a new transfer learning based approach that outperforms classical methods. Finally, we validate the proposed approach on two applications showing excellent accuracy and F1 score metrics.


Applying GMRES to the Helmholtz equation with strong trapping how does the number of iterations depend on the frequency?. We consider GMRES applied to discretisations of the high frequency Helmholtz equation with strong trapping recall that in this situation the problem is exponentially ill conditioned through an increasing sequence of frequencies. Under certain assumptions about the distribution of the eigenvalues, we prove upper bounds on how the number of GMRES iterations grows with the frequency. Our main focus is on boundary integral equation formulations of the exterior Dirichlet and Neumann obstacle problems in 2 and 3 d for these problems, we investigate numerically the sharpness (in terms of dependence on frequency) of both our bounds and various quantities entering our bounds. This paper is therefore the first comprehensive study of the frequency dependence of the number of GMRES iterations for Helmholtz boundary integral equations under trapping.


Puzzle Solving without Search or Human Knowledge An Unnatural Language Approach. The application of Generative Pre trained Transformer (GPT 2) to learn text archived game notation provides a model environment for exploring sparse reward gameplay. The transformer architecture proves amenable to training on solved text archives describing mazes, Rubik's Cube, and Sudoku solvers. The method benefits from fine tuning the transformer architecture to visualize plausible strategies derived outside any guidance from human heuristics or domain expertise. The large search space ( 10 19 ) for the games provides a puzzle environment in which the solution has few intermediate rewards and a final move that solves the challenge.


Differences in Chinese and Western tourists faced with Japanese hospitality A natural language processing approach. Since culture influences expectations, perceptions, and satisfaction, a cross culture study is necessary to understand the differences between Japan's biggest tourist populations, Chinese and Western tourists. However, with ever increasing customer populations, this is hard to accomplish without extensive customer base studies. There is a need for an automated method for identifying these expectations at a large scale. For this, we used a data driven approach to our analysis. Our study analyzed their satisfaction factors comparing soft attributes, such as service, with hard attributes, such as location and facilities, and studied different price ranges. We collected hotel reviews and extracted keywords to classify the sentiment of sentences with an SVC. We then used dependency parsing and part of speech tagging to extract nouns tied to positive adjectives. We found that Chinese tourists consider room quality more than hospitality, whereas Westerners are delighted more by staff behavior. Furthermore, the lack of a Chinese friendly environment for Chinese customers and cigarette smell for Western ones can be disappointing factors of their stay. As one of the first studies in the tourism field to use the high standard Japanese hospitality environment for this analysis, our cross cultural study contributes to both the theoretical understanding of satisfaction and suggests practical applications and strategies for hotel managers.


CAP Co Adversarial Perturbation on Weights and Features for Improving Generalization of Graph Neural Networks. Despite the recent advances of graph neural networks (GNNs) in modeling graph data, the training of GNNs on large datasets is notoriously hard due to the overfitting. Adversarial training, which augments data with the worst case adversarial examples, has been widely demonstrated to improve model's robustness against adversarial attacks and generalization ability. However, while the previous adversarial training generally focuses on protecting GNNs from spiteful attacks, it remains unclear how the adversarial training could improve the generalization abilities of GNNs in the graph analytics problem. In this paper, we investigate GNNs from the lens of weight and feature loss landscapes, i.e., the loss changes with respect to model weights and node features, respectively. We draw the conclusion that GNNs are prone to falling into sharp local minima in these two loss landscapes, where GNNs possess poor generalization performances. To tackle this problem, we construct the co adversarial perturbation (CAP) optimization problem in terms of weights and features, and design the alternating adversarial perturbation algorithm to flatten the weight and feature loss landscapes alternately. Furthermore, we divide the training process into two stages one conducting the standard cross entropy minimization to ensure the quick convergence of GNN models, the other applying our alternating adversarial training to avoid falling into locally sharp minima. The extensive experiments demonstrate our CAP can generally improve the generalization performance of GNNs on a variety of benchmark graph datasets.


Stochastic logarithmic Schrodinger equations energy regularized approach. In this paper, we prove the global existence and uniqueness of the solution of the stochastic logarithmic Schr "odinger (SlogS) equation driven by additive noise or multiplicative noise. The key ingredient lies on the regularized stochastic logarithmic Schr "odinger (RSlogS) equation with regularized energy and the strong convergence analysis of the solutions of (RSlogS) equations. In addition, temporal H "older regularity estimates and uniform estimates in energy space mathbb H 1( mathcal O) and weighted Sobolev space L 2 alpha ( mathcal O) of the solutions for both SlogS equation and RSlogS equation are also obtained.


MoCA Incorporating Multi stage Domain Pretraining and Cross guided Multimodal Attention for Textbook Question Answering. Textbook Question Answering (TQA) is a complex multimodal task to infer answers given large context descriptions and abundant diagrams. Compared with Visual Question Answering (VQA), TQA contains a large number of uncommon terminologies and various diagram inputs. It brings new challenges to the representation capability of language model for domain specific spans. And it also pushes the multimodal fusion to a more complex level. To tackle the above issues, we propose a novel model named MoCA, which incorporates multi stage domain pretraining and multimodal cross attention for the TQA task. Firstly, we introduce a multi stage domain pretraining module to conduct unsupervised post pretraining with the span mask strategy and supervised pre finetune. Especially for domain post pretraining, we propose a heuristic generation algorithm to employ the terminology corpus. Secondly, to fully consider the rich inputs of context and diagrams, we propose cross guided multimodal attention to update the features of text, question diagram and instructional diagram based on a progressive strategy. Further, a dual gating mechanism is adopted to improve the model ensemble. The experimental results show the superiority of our model, which outperforms the state of the art methods by 2.21 and 2.43 for validation and test split respectively.


Stochastic dynamics of generalized planar random motions with orthogonal directions. We study planar random motions with finite velocities, of norm c 0 , along orthogonal directions and changing at the instants of occurrence of a non homogeneous Poisson process with rate function lambda(t), t ge0 . We focus on the distribution of the current position bigl(X(t), Y(t) bigr), t ge0 , in the case where the motion has orthogonal deviations and where also reflection is admitted. In all the cases the process is located within the closed square S ct (x,y) in mathbb R 2 , , x y le ct and we obtain the probability law inside S ct , on the edge partial S ct and on the other possible singularities, by studying the partial differential equations governing all the distributions examined. A fundamental result is that the vector process bigl(X(t), Y(t) bigr) is probabilistically equivalent to a linear transformation of two (independent or dependent) one dimensional symmetric telegraph processes with rate function proportional to lambda(t) and velocity c 2 . Finally, we extend the results to a wider class of orthogonal type evolutions.


Log Fano blowups of mixed products of projective spaces and their effective cones. We compute the cones of effective divisors on blowups of mathbb P 1 times mathbb P 2 and mathbb P 1 times mathbb P 3 in up to 6 points. We also show that all these varieties are log Fano, giving a conceptual explanation for the fact that all the cones we compute are rational polyhedral.


Self adjoint operators associated with Hankel moment matrices. In a paper from 2016 D. R. Yafaev initiated a study of closable Hankel forms associated with the moments (m n) of a positive measure with infinite support on the real line. If m n o(1) Yafaev characterized the closure of the form based on earlier work on quasi Carleman operators. We give a new proof of the description of the closure based entirely on moment considerations. The main purpose of the present paper is a description of the self adjoint Hankel operators associated with closed Hankel forms in the Hilbert space of square summable sequences. We do this not only in the case m n o(1) studied by Yafaev but also in two other cases, where the Hankel form is closable, namely if the moment sequence is indeterminate or if the moment sequence is determinate with finite index of determinacy.


A massless boundary component mode synthesis method for elastodynamic contact problems. We propose to combine the ideas of mass redistribution and component mode synthesis. More specifically, we employ the MacNeal method, which readily leads to a singular mass matrix, and an accordingly modified version of the Craig Bampton method. Besides obtaining a massless boundary, we achieve a drastic reduction of the mathematical model order in this way compared to the parent finite element model. Contact is modeled using set valued laws and time stepping is carried out with a semi explicit scheme. We assess the method's computational performance by a series of benchmarks, including both frictionless and frictional contact. The results indicate that the proposed method achieves excellent energy conservation properties and superior convergence behavior. It reduces the spurious oscillations and decreases the computational effort by about 1 2 orders of magnitude compared to the current state of the art (mass carrying component mode synthesis method). We believe that the computational performance and favorable energy conservation properties will be valuable for the prediction of vibro impact processes and physical damping.


MatchVIE Exploiting Match Relevancy between Entities for Visual Information Extraction. Visual Information Extraction (VIE) task aims to extract key information from multifarious document images (e.g., invoices and purchase receipts). Most previous methods treat the VIE task simply as a sequence labeling problem or classification problem, which requires models to carefully identify each kind of semantics by introducing multimodal features, such as font, color, layout. But simply introducing multimodal features couldn't work well when faced with numeric semantic categories or some ambiguous texts. To address this issue, in this paper we propose a novel key value matching model based on a graph neural network for VIE (MatchVIE). Through key value matching based on relevancy evaluation, the proposed MatchVIE can bypass the recognitions to various semantics, and simply focuses on the strong relevancy between entities. Besides, we introduce a simple but effective operation, Num2Vec, to tackle the instability of encoded values, which helps model converge more smoothly. Comprehensive experiments demonstrate that the proposed MatchVIE can significantly outperform previous methods. Notably, to the best of our knowledge, MatchVIE may be the first attempt to tackle the VIE task by modeling the relevancy between keys and values and it is a good complement to the existing methods.


Model agnostic multi objective approach for the evolutionary discovery of mathematical models. In modern data science, it is often not enough to obtain only a data driven model with a good prediction quality. On the contrary, it is more interesting to understand the properties of the model, which parts could be replaced to obtain better results. Such questions are unified under machine learning interpretability questions, which could be considered one of the area's raising topics. In the paper, we use multi objective evolutionary optimization for composite data driven model learning to obtain the algorithm's desired properties. It means that whereas one of the apparent objectives is precision, the other could be chosen as the complexity of the model, robustness, and many others. The method application is shown on examples of multi objective learning of composite models, differential equations, and closed form algebraic expressions are unified and form approach for model agnostic learning of the interpretable models.


Features of aminopropyl modified mesoporous silica nanoparticles. Implications on the active targeting capability. Aminopropyl modified mesoporous SiO2 nanoparticles, MCM 41 type, have been synthesized by the co condensation method from tetraethylorthosilicate (TEOS) and aminopropyltriethoxysilane (APTES). By means of modifying TEOS APTES ratio we have carried out an in depth characterization of the nanoparticles as a function of APTES content. Surface charge and nanoparticles morphology were strongly influenced by the amount of APTES and particles changed from hexagonal to bean like morphology insofar APTES increased. Besides, the porous structure was also affected, showing a contraction of the lattice parameter and pore size, while increasing the wall thickness. These results bring about new insights about the nanoparticles formation during the co condensation process. The model proposed herein considers that different interactions stablished between TEOS and APTES with the structure directing agent have consequences on pore size, wall thickness and particle morphology. Finally, APTES is an excellent linker to covalently attach active targeting agents such as folate groups. We have hypothesized that APTES could also play a role in the biological behavior of the nanoparticles. So, the internalization efficiency of the nanoparticles has been tested with cancerous LNCaP and non cancerous preosteoblast like MC3T3 E1 cells. The results indicate a cooperative effect between aminopropylsilane presence and folic acid, only for the cancerous LNCaP cell line.


A Markov chain on the solution space of edge colorings of bipartite graphs. In this paper, we exhibit an irreducible Markov chain M on the edge k colorings of bipartite graphs based on certain properties of the solution space. We show that diameter of this Markov chain grows linearly with the number of edges in the graph. We also prove a polynomial upper bound on the inverse of acceptance ratio of the Metropolis Hastings algorithm when the algorithm is applied on M with the uniform distribution of all possible edge k colorings of G . A special case of our results is the solution space of the possible completions of Latin rectangles.


Weighted Norm Inequalities for the Opdam Cherednik Transform. In this paper, we study several weighted norm inequalities for the Opdam Cherednik transform. We establish different versions of the Heisenberg Pauli Weyl inequality for this transform. In particular, we give an extension of this inequality using weights with different exponents and present a variation of the inequality that incorporates L p norms for the Opdam Cherednik transform. Also, we prove a version of the Hardy Littlewood inequality for this transform. Finally, we give other variations of the Heisenberg Pauli Weyl inequality such as the Nash type and Clarkson type inequalities for the Opdam Cherednik transform.


Tumor and microcalcification characterization using Entropy, Fractal Dimension and intensity values statistical analysis in mammography. Digital analysis of mammographic images is a complementary tool to clinical evaluation, commonly used to identify tumors and or microcalcifications in mammograms. Recent mammographic equipment, can automatically classify them using this methodology. The difficulty in finding and classifying such areas, arise from different factors such as image acquisition methodology, excess of brightness, similar physiological and radiological properties of tissues, etc. In this work it is proposed that the numerical computations of fractal dimension and entropy are tools that could be used to automatically segment and distinguish malignant tumors and or microcalcifications in digital mammograms. The study consisted in segment the image in two areas background and confirmed malignant tumor and or microcalcification, to which the fractal dimension and entropy values are calculated and it was found the correlation between them. The analysis was performed on a grayscale re digitized images from images provided locally by hospital for microcalcifications and from public databases for malignant tumors. From these re digitized images, it was able to give the exact coordinates as the diagnosis provides. For any image, the highest intensity value was located in the tumor and or microcalcification area, resulting that the fractal dimension had a higher value than the rest of the image, while the entropy value was lower, due to the uniformity of intensities in these areas. To complete this study, it was performed a data analysis with the set of intensities in each area. This allowed to distinguish between the areas of interest according to the value of the intensities, having a value greater than 3 sigma . Finally, it is shown a technique to visually highlight the malignant tumor and or microcalcification.


BigCQ A large scale synthetic dataset of competency question patterns formalized into SPARQL OWL query templates. Competency Questions (CQs) are used in many ontology engineering methodologies to collect requirements and track the completeness and correctness of an ontology being constructed. Although they are frequently suggested by ontology engineering methodologies, the publicly available datasets of CQs and their formalizations in ontology query languages are very scarce. Since first efforts to automate processes utilizing CQs are being made, it is of high importance to provide large and diverse datasets to fuel these solutions. In this paper, we present BigCQ, the biggest dataset of CQ templates with their formalizations into SPARQL OWL query templates. BigCQ is created automatically from a dataset of frequently used axiom shapes. These pairs of CQ templates and query templates can be then materialized as actual CQs and SPARQL OWL queries if filled with resource labels and IRIs from a given ontology. We describe the dataset in detail, provide a description of the process leading to the creation of the dataset and analyze how well the dataset covers real world examples. We also publish the dataset as well as scripts transforming axiom shapes into pairs of CQ patterns and SPARQL OWL templates, to make engineers able to adapt the process to their particular needs.


AlephBERT A Hebrew Large Pre Trained Language Model to Start off your Hebrew NLP Application With. Large Pre trained Language Models (PLMs) have become ubiquitous in the development of language understanding technology and lie at the heart of many artificial intelligence advances. While advances reported for English using PLMs are unprecedented, reported advances using PLMs in Hebrew are few and far between. The problem is twofold. First, Hebrew resources available for training NLP models are not at the same order of magnitude as their English counterparts. Second, there are no accepted tasks and benchmarks to evaluate the progress of Hebrew PLMs on. In this work we aim to remedy both aspects. First, we present AlephBERT, a large pre trained language model for Modern Hebrew, which is trained on larger vocabulary and a larger dataset than any Hebrew PLM before. Second, using AlephBERT we present new state of the art results on multiple Hebrew tasks and benchmarks, including Segmentation, Part of Speech Tagging, full Morphological Tagging, Named Entity Recognition and Sentiment Analysis. We make our AlephBERT model publicly available, providing a single point of entry for the development of Hebrew NLP applications.


Can You Hear It? Backdoor Attacks via Ultrasonic Triggers. This work explores backdoor attacks for automatic speech recognition systems where we inject inaudible triggers. By doing so, we make the backdoor attack challenging to detect for legitimate users, and thus, potentially more dangerous. We conduct experiments on two versions of a speech dataset and three neural networks and explore the performance of our attack concerning the duration, position, and type of the trigger. Our results indicate that less than 1 of poisoned data is sufficient to deploy a backdoor attack and reach a 100 attack success rate. We observed that short, non continuous triggers result in highly successful attacks. However, since our trigger is inaudible, it can be as long as possible without raising any suspicions making the attack more effective. Finally, we conducted our attack in actual hardware and saw that an adversary could manipulate inference in an Android application by playing the inaudible trigger over the air.


RMA Rapid Motor Adaptation for Legged Robots. Successful real world deployment of legged robots would require them to adapt in real time to unseen scenarios like changing terrains, changing payloads, wear and tear. This paper presents Rapid Motor Adaptation (RMA) algorithm to solve this problem of real time online adaptation in quadruped robots. RMA consists of two components a base policy and an adaptation module. The combination of these components enables the robot to adapt to novel situations in fractions of a second. RMA is trained completely in simulation without using any domain knowledge like reference trajectories or predefined foot trajectory generators and is deployed on the A1 robot without any fine tuning. We train RMA on a varied terrain generator using bioenergetics inspired rewards and deploy it on a variety of difficult terrains including rocky, slippery, deformable surfaces in environments with grass, long vegetation, concrete, pebbles, stairs, sand, etc. RMA shows state of the art performance across diverse real world as well as simulation experiments. Video results at https ashish kmr.github.io rma legged robots


MetricHaven More Than 23,000 Metrics for Measuring Quality Attributes of Software Product Lines. Variability aware metrics are designed to measure qualitative aspects of software product lines. As we identified in a prior SLR cite El SharkawyYamagishi EichlerSchmid19 , there exist already many metrics that address code or variability separately, while the combination of both has been less researched. MetricHaven fills this gap, as it extensively supports combining information from code files and variability models. Further, we also enable the combination of well established single system metrics with novel variability aware metrics, going beyond existing variability aware metrics. Our tool supports most prominent single system and variability aware code metrics. We provide configuration support for already implemented metrics, resulting in 23,342 metric variations. Further, we present an abstract syntax tree developed for MetricHaven, that allows the realization of additional code metrics. Tool https github.com KernelHaven MetricHaven Video https youtu.be vPEmD5Sr6gM


Program Repair for Hyperproperties. We study the repair problem for hyperproperties specified in the temporal logic HyperLTL. Hyperproperties are system properties that relate multiple computation traces. This class of properties includes information flow policies like noninterference and observational determinism. The repair problem is to find, for a given Kripke structure, a substructure that satisfies a given specification. We show that the repair problem is decidable for HyperLTL specifications and finite state Kripke structures. We provide a detailed complexity analysis for different fragments of HyperLTL and different system types tree shaped, acyclic, and general Kripke structures.


Fitting Distances by Tree Metrics Minimizing the Total Error within a Constant Factor. We consider the numerical taxonomy problem of fitting a positive distance function D S choose 2 rightarrow mathbb R 0 by a tree metric. We want a tree T with positive edge weights and including S among the vertices so that their distances in T match those in D . A nice application is in evolutionary biology where the tree T aims to approximate the branching process leading to the observed distances in D Cavalli Sforza and Edwards 1967 . We consider the total error, that is the sum of distance errors over all pairs of points. We present a deterministic polynomial time algorithm minimizing the total error within a constant factor. We can do this both for general trees, and for the special case of ultrametrics with a root having the same distance to all vertices in S . The problems are APX hard, so a constant factor is the best we can hope for in polynomial time. The best previous approximation factor was O(( log n)( log log n)) by Ailon and Charikar 2005 who wrote "Determining whether an O(1) approximation can be obtained is a fascinating question".


Finite element algorithms for nonlocal minimal graphs. We discuss computational and qualitative aspects of the fractional Plateau and the prescribed fractional mean curvature problems on bounded domains subject to exterior data being a subgraph. We recast these problems in terms of energy minimization, and we discretize the latter with piecewise linear finite elements. For the computation of the discrete solutions, we propose and study a gradient flow and a Newton scheme, and we quantify the effect of Dirichlet data truncation. We also present a wide variety of numerical experiments that illustrate qualitative and quantitative features of fractional minimal graphs and the associated discrete problems.


More layers! End to end regression and uncertainty on tabular data with deep learning. This paper attempts to analyze the effectiveness of deep learning for tabular data processing. It is believed that decision trees and their ensembles is the leading method in this domain, and deep neural networks must be content with computer vision and so on. But the deep neural network is a framework for building gradient based hierarchical representations, and this key feature should be able to provide the best processing of generic structured (tabular) data, not just image matrices and audio spectrograms. This problem is considered through the prism of the Weather Prediction track in the Yandex Shifts challenge (in other words, the Yandex Shifts Weather task). This task is a variant of the classical tabular data regression problem. It is also connected with another important problem generalization and uncertainty in machine learning. This paper proposes an end to end algorithm for solving the problem of regression with uncertainty on tabular data, which is based on the combination of four ideas 1) deep ensemble of self normalizing neural networks, 2) regression as parameter estimation of the Gaussian target error distribution, 3) hierarchical multitask learning, and 4) simple data preprocessing. Three modifications of the proposed algorithm form the top 3 leaderboard of the Yandex Shifts Weather challenge respectively. This paper considers that this success has occurred due to the fundamental properties of the deep learning algorithm, and tries to prove this.


Fine tuning Encoders for Improved Monolingual and Zero shot Polylingual Neural Topic Modeling. Neural topic models can augment or replace bag of words inputs with the learned representations of deep pre trained transformer based word prediction models. One added benefit when using representations from multilingual models is that they facilitate zero shot polylingual topic modeling. However, while it has been widely observed that pre trained embeddings should be fine tuned to a given task, it is not immediately clear what supervision should look like for an unsupervised task such as topic modeling. Thus, we propose several methods for fine tuning encoders to improve both monolingual and zero shot polylingual neural topic modeling. We consider fine tuning on auxiliary tasks, constructing a new topic classification task, integrating the topic classification objective directly into topic model training, and continued pre training. We find that fine tuning encoder representations on topic classification and integrating the topic classification task directly into topic modeling improves topic quality, and that fine tuning encoder representations on any task is the most important factor for facilitating cross lingual transfer.


Bootstrapping Generalization of Process Models Discovered From Event Data. Process mining extracts value from the traces recorded in the event logs of IT systems, with process discovery the task of inferring a process model for a log emitted by some unknown system. Generalization is one of the quality criteria applied to process models to quantify how well the model describes future executions of the system. Generalization is also perhaps the least understood of those criteria, with that lack primarily a consequence of it measuring properties over the entire future behavior of the system when the only available sample of behavior is that provided by the log. In this paper, we apply a bootstrap approach from computational statistics, allowing us to define an estimator of the model's generalization based on the log it was discovered from. We show that standard process mining assumptions lead to a consistent estimator that makes fewer errors as the quality of the log increases. Experiments confirm the ability of the approach to support industry scale data driven systems engineering.


A linear parallel algorithm to compute bisimulation and relational coarsest partitions. The most efficient way to calculate strong bisimilarity is by calculation the relational coarsest partition on a transition system. We provide the first linear time algorithm to calculate strong bisimulation using parallel random access machines (PRAMs). More precisely, with n states, m transitions and mathit Act leq m action labels, we provide an algorithm on max(n,m) processors that calculates strong bisimulation in time O(n mathit Act ) and space O(n m) . The best known PRAM algorithm has time complexity O(n log n) on a smaller number of processors making it less suitable for massive parallel devices such as GPUs. An implementation on a GPU shows that the linear time bound is achievable on contemporary hardware.


Effect of time dependent infectiousness on epidemic dynamics. In contrast to the common assumption in epidemic models that the rate of infection between individuals is constant, in reality, an individual's viral load determines their infectiousness. We compare the average and individual reproductive numbers and epidemic dynamics for a model incorporating time dependent infectiousness and a standard SIR model for both fully mixed and category mixed populations. We find that the reproductive number only depends on the total infectious exposure and the largest eigenvalue of the mixing matrix and that these two effects are independent of each other. When we compare our time dependent mean field model to the SIR model with equivalent rates, the epidemic peak is advanced and modifying the infection rate function has a strong effect on the time dynamics of the epidemic. We also observe behavior akin to a traveling wave as individuals transition through infectious states.


On lower estimations of square linear ratio for plane Peano curves. It is proved that for any mapping of a unit segment to a unit square, there is a pair of points of the segment for which the square of the Euclidean distance between their images exceeds the distance between them on the segment by at least 3 frac58 times. And the additional condition that the images of the beginning and end of the segment belong to opposite sides of the square increases the estimate to 4 varepsilon .


Feature Pyramid Network for Multi task Affective Analysis. Affective Analysis is not a single task, and the valence arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of these three facial attributes. We propose a novel model named feature pyramid networks for multi task affect analysis. The hierarchical features are extracted to predict three labels and we apply a teacher student training strategy to learn from pretrained single task models. Extensive experiment results demonstrate the proposed model outperforms other models. This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). The code and model are available for research purposes at https github.com ryanhe312 ABAW2 FPNMAA.


Towards glass box CNNs. Convolution neural networks (CNNs) are brain inspired architectures popular for their ability to train and relearn visually complex tasks. It is incremental and scalable however, CNN is mostly treated as black box and involves multiple trial error runs. We observe that CNN constructs powerful internal representations that help achieve state of the art performance. Here we propose three layer glass box (analytical) CNN for two class image classifcation problems. First is a representation layer that encompasses both the class information (group invariant) and symmetric transformations (group equivariant) of input images. It is then passed through dimension reduction layer (PCA). Finally the compact yet complete representation is provided to a classifer. Analytical machine learning classifers and multilayer perceptrons are used to assess sensitivity. Proposed glass box CNN is compared with equivariance of AlexNet (CNN) internal representation for better understanding and dissemination of results. In future, we would like to construct glass box CNN for multiclass visually complex tasks.


Probabilistic Loss and its Online Characterization for Simplified Decision Making Under Uncertainty. It is a long standing objective to ease the computation burden incurred by the decision making process. Identification of this mechanism's sensitivity to simplification has tremendous ramifications. Yet, algorithms for decision making under uncertainty usually lean on approximations or heuristics without quantifying their effect. Therefore, challenging scenarios could severely impair the performance of such methods. In this paper, we extend the decision making mechanism to the whole by removing standard approximations and considering all previously suppressed stochastic sources of variability. On top of this extension, our key contribution is a novel framework to simplify decision making while assessing and controlling online the simplification's impact. Furthermore, we present novel stochastic bounds on the return and characterize online the effect of simplification using this framework on a particular simplification technique reducing the number of samples in belief representation for planning. Finally, we verify the advantages of our approach through extensive simulations.


Understanding the Information Needs and Practices of Human Supporters of an Online Mental Health Intervention to Inform Machine Learning Applications. In the context of digital therapy interventions, such as internet delivered Cognitive Behavioral Therapy (iCBT) for the treatment of depression and anxiety, extensive research has shown how the involvement of a human supporter or coach, who assists the person undergoing treatment, improves user engagement in therapy and leads to more effective health outcomes than unsupported interventions. Seeking to maximize the effects and outcomes of this human support, the research investigates how new opportunities provided through recent advances in the field of AI and machine learning (ML) can contribute useful data insights to effectively support the work practices of iCBT supporters. This paper reports detailed findings of an interview study with 15 iCBT supporters that deepens understanding of their existing work practices and information needs with the aim to meaningfully inform the development of useful, implementable ML applications particularly in the context of iCBT treatment for depression and anxiety. The analysis contributes (1) a set of six themes that summarize the strategies and challenges that iCBT supporters encounter in providing effective, personalized feedback to their mental health clients and in response to these learnings, (2) presents for each theme concrete opportunities for how methods of ML could help support and address identified challenges and information needs. It closes with reflections on potential social, emotional and pragmatic implications of introducing new machine generated data insights within supporter led client review practices.


Hodge theory, between algebraicity and transcendence. The Hodge theory of complex algebraic varieties is at heart a transcendental comparison of two algebraic structures. We survey the recent advances bounding this transcendence, mainly due to the introduction of o minimal geometry as a natural framework for Hodge theory.


Complete classification of gradient blow up and recovery of boundary condition for the viscous Hamilton Jacobi equation. We study the Cauchy Dirichlet pbm for superquadratic viscous Hamilton Jacobi eq. We give a complete classification, namely rates and space time profiles, in 1d case when viscosity sol. undergo gradient blow up (GBU) or recovery of boundary condition (RBC) at any time when such phenomenon occurs. These results can be modified in radial domains in general dimensions. Previously, upper and lower estimates of GBU or RBC rates were available only in special case when basic comparison principle can be used. Even for type II BU in other PDEs, as far as we know, there has been no complete classification except 50 , in which the argument relies on features peculiar to chemotaxis syst. Whereas there are many results on construction of special type II BU sol. of PDEs with investigation of (in )stability of bubble, determination of (in )stability of space time profile for general sol. has not been done. In this paper, we determine whether space time profile for each sol. is stable or unstable. A key in our proofs is to focus on algebraic structure with respect to vanishing intersections with singular steady state. In turn, GBU and RBC rates and profiles, as well as their (in )stability, can be completely characterized by the number of vanishing intersections. We construct special sol. in bounded and unbounded intervals in both GBU and RBC cases, based on methods from 29 , and then apply braid group theory to get upper and lower estimates of the rates. After that, we rule out oscillation of the rates, which leads us to the complete space time profile. In the process, careful construction of special sol. with specific behaviors in intermediate and outer regions, far from bubble and the RBC point, plays essential role. The application of such techniques to viscosity sol. is completely new.


An endpoint estimate of the bilinear paraboloid restriction operator. In Fourier restriction problems, a cone and a paraboloid are model surfaces. The sharp bilinear cone restriction estimate was first shown by Wolff, and later the endpoint was obtained by Tao. For a paraboloid, the sharp L 2 bilinear restriction estimate was obtained by Tao, but the endpoint was remained open. In this paper we prove the endpoint L 2 bilinear restriction estimate for a paraboloid.


Weakly Supervised Multi Object Tracking and Segmentation. We introduce the problem of weakly supervised Multi Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi object tracking, in which we do not provide any kind of mask annotation. To address it, we design a novel synergistic training strategy by taking advantage of multi task learning, i.e. classification and tracking tasks guide the training of the unsupervised instance segmentation. For that purpose, we extract weak foreground localization information, provided by Grad CAM heatmaps, to generate a partial ground truth to learn from. Additionally, RGB image level information is employed to refine the mask prediction at the edges of the objects. We evaluate our method on KITTI MOTS, the most representative benchmark for this task, reducing the performance gap on the MOTSP metric between the fully supervised and weakly supervised approach to just 12 and 12.7 for cars and pedestrians, respectively.


A Scalable Algorithm for Decentralized Actor Termination Detection. Automatic garbage collection (GC) prevents certain kinds of bugs and reduces programming overhead. GC techniques for sequential programs are based on reachability analysis. However, testing reachability from a root set is inadequate for determining whether an actor is garbage Observe that an unreachable actor may send a message to a reachable actor. Instead, it is sufficient to check termination (sometimes also called quiescence) an actor is terminated if it is not currently processing a message and cannot receive a message in the future. Moreover, many actor frameworks provide all actors with access to file I O or external storage without inspecting an actor's internal code, it is necessary to check that the actor has terminated to ensure that it may be garbage collected in these frameworks. Previous algorithms to detect actor garbage require coordination mechanisms such as causal message delivery or nonlocal monitoring of actors for mutation. Such coordination mechanisms adversely affect concurrency and are therefore expensive in distributed systems. We present a low overhead deferred reference listing technique (called DRL) for termination detection in actor systems. DRL is based on asynchronous local snapshots and message passing between actors. This enables a decentralized implementation and transient network partition tolerance. The paper provides a formal description of DRL, shows that all actors identified as garbage have indeed terminated (safety), and that all terminated actors under certain reasonable assumptions will eventually be identified (liveness).


A comprehensive solution to retrieval based chatbot construction. In this paper we present the results of our experiments in training and deploying a self supervised retrieval based chatbot trained with contrastive learning for assisting customer support agents. In contrast to most existing research papers in this area where the focus is on solving just one component of a deployable chatbot, we present an end to end set of solutions to take the reader from an unlabelled chatlogs to a deployed chatbot. This set of solutions includes creating a self supervised dataset and a weakly labelled dataset from chatlogs, as well as a systematic approach to selecting a fixed list of canned responses. We present a hierarchical based RNN architecture for the response selection model, chosen for its ability to cache intermediate utterance embeddings, which helped to meet deployment inference speed requirements. We compare the performance of this architecture across 3 different learning objectives self supervised contrastive learning, binary classification, and multi class classification. We find that using a self supervised contrastive learning model outperforms training the binary and multi class classification models on a weakly labelled dataset. Our results validate that the self supervised contrastive learning approach can be effectively used for a real world chatbot scenario.


DRL based Slice Placement under Realistic Network Load Conditions. We propose to demonstrate a network slice placement optimization solution based on Deep Reinforcement Learning (DRL), referred to as Heuristically controlled DRL, which uses a heuristic to control the DRL algorithm convergence. The solution is adapted to realistic networks with large scale and under non stationary traffic conditions (namely, the network load). We demonstrate the applicability of the proposed solution and its higher and stable performance over a non controlled DRL based solution. Demonstration scenarios include full online learning with multiple volatile network slice placement request arrivals.


Class Incremental Learning for Wireless Device Identification in IoT. Deep Learning (DL) has been utilized pervasively in the Internet of Things (IoT). One typical application of DL in IoT is device identification from wireless signals, namely Non cryptographic Device Identification (NDI). However, learning components in NDI systems have to evolve to adapt to operational variations, such a paradigm is termed as Incremental Learning (IL). Various IL algorithms have been proposed and many of them require dedicated space to store the increasing amount of historical data, and therefore, they are not suitable for IoT or mobile applications. However, conventional IL schemes can not provide satisfying performance when historical data are not available. In this paper, we address the IL problem in NDI from a new perspective, firstly, we provide a new metric to measure the degree of topological maturity of DNN models from the degree of conflict of class specific fingerprints. We discover that an important cause for performance degradation in IL enabled NDI is owing to the conflict of devices' fingerprints. Second, we also show that the conventional IL schemes can lead to low topological maturity of DNN models in NDI systems. Thirdly, we propose a new Channel Separation Enabled Incremental Learning (CSIL) scheme without using historical data, in which our strategy can automatically separate devices' fingerprints in different learning stages and avoid potential conflict. Finally, We evaluated the effectiveness of the proposed framework using real data from ADS B (Automatic Dependent Surveillance Broadcast), an application of IoT in aviation. The proposed framework has the potential to be applied to accurate identification of IoT devices in a variety of IoT applications and services. Data and code available at IEEE Dataport (DOI 10.21227 1bxc ke87) and url https github.com pcwhy CSIL


CLOAK A Framework For Development of Confidential Blockchain Smart Contracts. In recent years, as blockchain adoption has been expanding across a wide range of domains, e.g., digital asset, supply chain finance, etc., the confidentiality of smart contracts is now a fundamental demand for practical applications. However, while new privacy protection techniques keep coming out, how existing ones can best fit development settings is little studied. Suffering from limited architectural support in terms of programming interfaces, state of the art solutions can hardly reach general developers. In this paper, we proposed the CLOAK framework for developing confidential smart contracts. The key capability of CLOAK is allowing developers to implement and deploy practical solutions to multi party transaction (MPT) problems, i.e., transact with secret inputs and states owned by different parties by simply specifying it. To this end, CLOAK introduced a domain specific annotation language for declaring privacy specifications and further automatically generating confidential smart contracts to be deployed with trusted execution environment (TEE) on blockchain. In our evaluation on both simple and real world applications, developers managed to deploy business services on blockchain in a concise manner by only developing CLOAK smart contracts whose size is less than 30 of the deployed ones.


Coefficients' Settings in Particle Swarm Optimization Insight and Guidelines. Particle Swam Optimization is a population based and gradient free optimization method developed by mimicking social behaviour observed in nature. Its ability to optimize is not specifically implemented but emerges in the global level from local interactions. In its canonical version, there are three factors that govern a particle's trajectory 1) inertia from its previous displacement 2) attraction to its best experience and 3) attraction to a given neighbour's best experience. The importance given to each of these factors is regulated by three coefficients 1) the inertia 2) the individuality and 3) the sociality weights. Their settings rule the trajectory of the particle when pulled by these two attractors. Different speeds and forms of convergence of a particle towards its attractor(s) take place for different settings of the coefficients. A more general formulation is presented aiming for a better control of the embedded randomness. Guidelines to select the coefficients' settings to obtain the desired behaviour are offered. The convergence speed of the algorithm also depends on the speed of spread of information within the swarm. The latter is governed by the structure of the neighbourhood, whose study is beyond the scope of this paper. The objective here is to help understand the core of the PSO paradigm from the bottom up by offering some insight into the form of the particles' trajectories, and to provide some guidelines as to how to decide upon the settings of the coefficients in the particles' velocity update equation in the proposed formulation to obtain the type of behaviour desired for the problem at hand. General purpose settings are also suggested. The relationship between the proposed formulation and both the classical and constricted PSO formulations are also provided.


Towards Productizing AI ML Models An Industry Perspective from Data Scientists. The transition from AI ML models to production ready AI based systems is a challenge for both data scientists and software engineers. In this paper, we report the results of a workshop conducted in a consulting company to understand how this transition is perceived by practitioners. Starting from the need for making AI experiments reproducible, the main themes that emerged are related to the use of the Jupyter Notebook as the primary prototyping tool, and the lack of support for software engineering best practices as well as data science specific functionalities.


Blockchain and smart contract for IoT enabled smart agriculture. The agricultural sector is still lagging behind from all other sectors in terms of using the newest technologies. For production, the latest machines are being introduced and adopted. However, pre harvest and post harvest processing are still done by following traditional methodologies while tracing, storing, and publishing agricultural data. As a result, farmers are not getting deserved payment, consumers are not getting enough information before buying their product, and intermediate person processors are increasing retail prices. Using blockchain, smart contracts, and IoT devices, we can fully automate the process while establishing absolute trust among all these parties. In this research, we explored the different aspects of using blockchain and smart contracts with the integration of IoT devices in pre harvesting and post harvesting segments of agriculture. We proposed a system that uses blockchain as the backbone while IoT devices collect data from the field level, and smart contracts regulate the interaction among all these contributing parties. The system implementation has been shown in diagrams and with proper explanations. Gas costs of every operation have also been attached for a better understanding of the costs. We also analyzed the system in terms of challenges and advantages. The overall impact of this research was to show the immutable, available, transparent, and robustly secure characteristics of blockchain in the field of agriculture while also emphasizing the vigorous mechanism that the collaboration of blockchain, smart contract, and IoT presents.


A Survey on Human and Personality Vulnerability Assessment in Cyber security Challenges, Approaches, and Open Issues. These days, cyber criminals target humans rather than machines since they try to accomplish their malicious intentions by exploiting the weaknesses of end users. Thus, human vulnerabilities pose a serious threat to the security and integrity of computer systems and data. The human tendency to trust and help others, as well as personal, social, and cultural characteristics, are indicative of the level of susceptibility that one may exhibit towards certain attack types and deception strategies. This work aims to investigate the factors that affect human susceptibility by studying the existing literature related to this subject. The objective is also to explore and describe state of the art human vulnerability assessment models, current prevention, and mitigation approaches regarding user susceptibility, as well as educational and awareness raising training strategies. Following the review of the literature, several conclusions are reached. Among them, Human Vulnerability Assessment has been included in various frameworks aiming to assess the cyber security capacity of organizations, but it concerns a one time assessment rather than a continuous practice. Moreover, human maliciousness is still neglected from current Human Vulnerability Assessment frameworks thus, insider threat actors evade identification, which may lead to an increased cyber security risk. Finally, this work proposes a user susceptibility profile according to the factors stemming from our research.


On transformation formulas of p adic hypergeometric functions mathscr F a,...,a ( sigma) (t) and widehat mathscr F a,...,a ( sigma) (t) . In this paper, we recall hypergeometric functions mathscr F rm Dw a 1, cdots,a s (t), mathscr F ( sigma) a 1, cdots,a s (t) , widehat mathscr F ( sigma) a, cdots,a (t) and their transformation formulas. Then we prove that one of transformation formula implies another.


The geometry of spectral interlacing. We provide a detailed description of the maps associated with spectral interlacing, for rank one perturbations and bordering of symmetric and Hermitian matrices. The arguments rely on standard techniques of nonlinear analysis.


Extremal mild solutions for Hilfer fractional evolution equation with mixed monotone Impulsive conditions. The well established mixed monotone iterative technique that is used to study the existence and uniqueness of fractional order system is studied explicitly for impulsive system with Hilfer fractional order in this paper. The procedure of finding mild L quasi solution of such impulsive evolution equation with noncomapct semigroups involves measure of non compactness and Sadovskii's fixed point theorem as well. An example is provided to illustrate the main results.


A Heavy Traffic Theory of Two Sided Queues. Motivated by emerging applications in online matching platforms and marketplaces, we study a two sided queue. Customers and servers that arrive into a two sided queue depart as soon as they are matched. It is known that a state dependent control is needed to ensure the stability of a two sided queue. However, analytically studying the steady state behaviour of a two sided queue, in general, is challenging. Therefore, inspired by the heavy traffic regime in classical queueing theory, we study a two sided queue in an asymptotic regime where the control decreases to zero. It turns out that there are two different ways the control can be sent to zero, and we model these using two parameters viz., epsilon that goes to zero and tau that goes to infinity. Intuitively, epsilon modulates the magnitude of the control and tau is the threshold after which we modulate the control. We show that depending on the relative rates of epsilon and tau , there is a phase transition in the limiting regime. We christen the regime when epsilon tau to 0 , the quality driven regime, and the limiting behaviour is a Laplace distribution. The phase transition starts in the regime when, epsilon tau goes to a nonzero constant when the limiting distribution is a Gibbs distribution, and so we call it the critical regime. When epsilon tau to infty , we conjecture that the limiting distribution is uniform and prove that in a special case. We call this the profit driven regime. These results are established using two related proof techniques. The first one is a generalization of the characteristic function method, and the second is a novel inverse Fourier transform method.


Note on the q Logarithmic Sobolev and p Talagrand Inequalities on Carnot Groups. In the setting of Carnot groups, we prove the q Logarithmic Sobolev inequality for probability measures as a function of the Carnot Carath 'eodory distance. As an application, we use the Hamilton Jacobi equation in the setting of Carnot groups to prove the p Talagrand inequality and hypercontractivity.


Dynamically Addressing Unseen Rumor via Continual Learning. Rumors are often associated with newly emerging events, thus, an ability to deal with unseen rumors is crucial for a rumor veracity classification model. Previous works address this issue by improving the model's generalizability, with an assumption that the model will stay unchanged even after the new outbreak of an event. In this work, we propose an alternative solution to continuously update the model in accordance with the dynamics of rumor domain creations. The biggest technical challenge associated with this new approach is the catastrophic forgetting of previous learnings due to new learnings. We adopt continual learning strategies that control the new learnings to avoid catastrophic forgetting and propose an additional strategy that can jointly be used to strengthen the forgetting alleviation.


Greedy Gradient Ensemble for Robust Visual Question Answering. Language bias is a critical issue in Visual Question Answering (VQA), where models often exploit dataset biases for the final decision without considering the image information. As a result, they suffer from performance drop on out of distribution data and inadequate visual explanation. Based on experimental analysis for existing robust VQA methods, we stress the language bias in VQA that comes from two aspects, i.e., distribution bias and shortcut bias. We further propose a new de bias framework, Greedy Gradient Ensemble (GGE), which combines multiple biased models for unbiased base model learning. With the greedy strategy, GGE forces the biased models to over fit the biased data distribution in priority, thus makes the base model pay more attention to examples that are hard to solve by biased models. The experiments demonstrate that our method makes better use of visual information and achieves state of the art performance on diagnosing dataset VQA CP without using extra annotations.


Physics informed neural network simulation of multiphase poroelasticity using stress split sequential training. Physics informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward problems, however, pose significant challenges, mainly because of the complex non convex and multi objective loss function. In this work, we present a PINN approach to solving the equations of coupled flow and deformation in porous media for both single phase and multiphase flow. To this end, we construct the solution space using multi layer neural networks. Due to the dynamics of the problem, we find that incorporating multiple differential relations into the loss function results in an unstable optimization problem, meaning that sometimes it converges to the trivial null solution, other times it moves very far from the expected solution. We report a dimensionless form of the coupled governing equations that we find most favourable to the optimizer. Additionally, we propose a sequential training approach based on the stress split algorithms of poromechanics. Notably, we find that sequential training based on stress split performs well for different problems, while the classical strain split algorithm shows an unstable behaviour similar to what is reported in the context of finite element solvers. We use the approach to solve benchmark problems of poroelasticity, including Mandel's consolidation problem, Barry Mercer's injection production problem, and a reference two phase drainage problem. The Python SciANN codes reproducing the results reported in this manuscript will be made publicly available at https github.com sciann sciann applications.


Sensitivity of the YbOH molecule to mathcal P , mathcal T odd effects in the external electric field. Electron electric dipole moment (eEDM) search using lasercoolable triatomics like YbOH is one of the most sensitive probes for physics beyond the Standard Model. The eEDM induced energy shift is proportional to polarization ( P ) of the molecule. Similarly to diatomics with Omega doubling structure it was assumed that for triatomics with l doubling structure P can easily be saturated to almost 100 value with moderate external electric field. We developed the method for calculation of properties of triatomic molecules and applied it to calculation of P of 174 YbOH in the first excited v 1 bending mode. Calculations showed that the most of the levels reach less than 50 efficiency. We showed that this fact is related to the Hund's case b coupling scheme of YbOH. As coupling scheme (for Omega 1 2 molecules) approaches a (or c ) case polarization increases up to 100 value. Results of our calculations should be used for correct extracting of eEDM value from YbOH experiment and similar calculations are required for other molecules.


Pathwise approximations for the solution of the non linear filtering problem. We consider high order approximations of the solution of the stochastic filtering problem, derive their pathwise representation in the spirit of the earlier work of Clark and Davis and prove their robustness property. In particular, we show that the high order discretised filtering functionals can be represented by Lipschitz continuous functions defined on the observation path space. This property is important from the practical point of view as it is in fact the pathwise version of the filtering functional that is sought in numerical applications. Moreover, the pathwise viewpoint will be a stepping stone into the rigorous development of machine learning methods for the filtering problem. This work is a continuation of a recent work by two of the authors where a discretisation of the solution of the filtering problem of arbitrary order has been established. We expand the previous work by showing that robust approximations can be derived from the discretisations therein.


Weak solutions for time fractional evolution equations in Hilbert spaces. We introduce a notion of weak solution for abstract fractional differential equations, motivated by the definition of Caputo derivative. We prove existence results for weak and strong solutions. We also give two examples as application of our results time fractional wave equations and time fractional Petrovsky systems.


Spectra of the zero divisor graph of finite rings. The zero divisor graph Gamma(R) of a ring R is a graph with nonzero zero divisors of R as vertices and distinct vertices x,y are adjacent if xy 0 or yx 0 . We provide an equivalence relation on a ring R and express Gamma(R) as a generalized join of graphs on equivalence classes of this relation. We determined the adjacency and Lapalcian spectra of Gamma(R) when R is a finite semisimple ring.


Large, moderate deviations principle and alpha limit for the 2D Stochastic LANS alpha . In this paper we consider the Lagrangian Averaged Navier Stokes Equations, also known as, LANS alpha Navier Stokes model on the two dimensional torus. We assume that the noise is a cylindrical Wiener process and its coefficient is multiplied by sqrt alpha . We then study through the lenses of the large and moderate deviations principle the behaviour of the trajectories of the solutions of the stochastic system as alpha goes to 0. Instead of giving two separate proofs of the two deviations principles we present a unifying approach to the proof of the LDP and MDP and express the rate function in term of the unique solution of the Navier Stokes equations. Our proof is based on the weak convergence approach to large deviations principle. As a by product of our analysis we also prove that the solutions of the stochastic LANS alpha model converge in probability to the solutions of the deterministic Navier Stokes equations.


Combining Embeddings and Fuzzy Time Series for High Dimensional Time Series Forecasting in Internet of Energy Applications. The prediction of residential power usage is essential in assisting a smart grid to manage and preserve energy to ensure efficient use. An accurate energy forecasting at the customer level will reflect directly into efficiency improvements across the power grid system, however forecasting building energy use is a complex task due to many influencing factors, such as meteorological and occupancy patterns. In addiction, high dimensional time series increasingly arise in the Internet of Energy (IoE), given the emergence of multi sensor environments and the two way communication between energy consumers and the smart grid. Therefore, methods that are capable of computing high dimensional time series are of great value in smart building and IoE applications. Fuzzy Time Series (FTS) models stand out as data driven non parametric models of easy implementation and high accuracy. Unfortunately, the existing FTS models can be unfeasible if all features were used to train the model. We present a new methodology for handling high dimensional time series, by projecting the original high dimensional data into a low dimensional embedding space and using multivariate FTS approach in this low dimensional representation. Combining these techniques enables a better representation of the complex content of multivariate time series and more accurate forecasts.


A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Tracking. Siamese trackers are shown to be vulnerable to adversarial attacks recently. However, the existing attack methods craft the perturbations for each video independently, which comes at a non negligible computational cost. In this paper, we show the existence of universal perturbations that can enable the targeted attack, e.g., forcing a tracker to follow the ground truth trajectory with specified offsets, to be video agnostic and free from inference in a network. Specifically, we attack a tracker by adding a universal imperceptible perturbation to the template image and adding a fake target, i.e., a small universal adversarial patch, into the search images adhering to the predefined trajectory, so that the tracker outputs the location and size of the fake target instead of the real target. Our approach allows perturbing a novel video to come at no additional cost except the mere addition operations and not require gradient optimization or network inference. Experimental results on several datasets demonstrate that our approach can effectively fool the Siamese trackers in a targeted attack manner. We show that the proposed perturbations are not only universal across videos, but also generalize well across different trackers. Such perturbations are therefore doubly universal, both with respect to the data and the network architectures. We will make our code publicly available.


Approximation of the Image of the Hilbert Schmidt Integral Operator. In this paper an approximation of the image of the closed ball of the space L p (p 1) centered at the origin with radius r under Hilbert Schmidt integral operator F( cdot) L p rightarrow L q displaystyle left( frac 1 p frac 1 q 1 right) is presented. An error estimation for given approximation is obtained.


The exceptional set for integers of the form (p 1) c (p 2) c . Let 1 c 24 19 . We show that the number of integers n le N that cannot be written as p 1 c p 2 c ( p 1 , p 2 primes) is O(N 1 sigma varepsilon ) . Here sigma is a positive function of c (given explicitly) and varepsilon is an arbitrary positive number.


Integral generalized equivariant cohomologies of GKM orbifolds and weighted Grassmann orbifolds. In this paper, we define simplicial GKM orbifold complexes' and simplicial GKM graph complexes'. We study some of their topological and combinatorial properties. We discuss some necessary conditions to confirm an invariant q cell structure on a simplicial GKM orbifold complex. We prove Thom isomorphism theorem for orbifold G vector bundles for equivariant cohomology and equivariant K theory with rational coefficients. We use this to extend the main result of Harada Henriques Holm (2005) to the category of G spaces equipped with singular invariant stratification'. Then we introduce an equivalent definition of weighted Grassmann orbifolds which were introduced by Corti and Reid (2002) and explicitly studied by Abe and Matsumura (2015) to compute their equivariant cohomology with rational coefficients. These orbifolds are a generalization of Grassmann manifolds. We study their different q cell structures and discuss some necessary conditions to determine if they have invariant CW structures. We employ the techniques from the first part to study some generalized equivariant cohomology theories of weighted Grassmann orbifolds. We introduce divisive' weighted Grassmann orbifolds and compute their equivariant cohomology, equivariant K theory and equivariant cobordism ring with integer coefficients. We discuss Schubert calculus for the equivariant cohomology ring and show how to compute the corresponding structure constants with integer coefficients.


Online anti Semitism across platforms. We created a fine grained AI system for the detection of anti Semitism. This Explainable AI will identify English and German anti Semitic expressions of dehumanization, verbal aggression and conspiracies in online social media messages across platforms, to support high level decision making.


Teach Me to Explain A Review of Datasets for Explainable Natural Language Processing. Explainable NLP (ExNLP) has increasingly focused on collecting human annotated textual explanations. These explanations are used downstream in three ways as data augmentation to improve performance on a predictive task, as supervision to train models to produce explanations for their predictions, and as a ground truth to evaluate model generated explanations. In this review, we identify 65 datasets with three predominant classes of textual explanations (highlights, free text, and structured), organize the literature on annotating each type, identify strengths and shortcomings of existing collection methodologies, and give recommendations for collecting ExNLP datasets in the future.


Geometrically exact static isogeometric analysis of arbitrarily curved plane Bernoulli Euler beam. We present a geometrically exact nonlinear analysis of elastic in plane beams in the context of finite but small strain theory. The formulation utilizes the full beam metric and obtains the complete analytic elastic constitutive model by employing the exact relation between the reference and equidistant strains. Thus, we account for the nonlinear strain distribution over the thickness of a beam. In addition to the full analytical constitutive model, four simplified ones are presented. Their comparison provides a thorough examination of the influence of a beam's metric on the structural response. We show that the appropriate formulation depends on the curviness of a beam at all configurations. Furthermore, the nonlinear distribution of strain along the thickness of strongly curved beams must be considered to obtain a complete and accurate response.


A Logical Characterization of the Preferred Models of Logic Programs with Ordered Disjunction. Logic Programs with Ordered Disjunction (LPODs) extend classical logic programs with the capability of expressing alternatives with decreasing degrees of preference in the heads of program rules. Despite the fact that the operational meaning of ordered disjunction is clear, there exists an important open issue regarding its semantics. In particular, there does not exist a purely model theoretic approach for determining the most preferred models of an LPOD. At present, the selection of the most preferred models is performed using a technique that is not based exclusively on the models of the program and in certain cases produces counterintuitive results. We provide a novel, model theoretic semantics for LPODs, which uses an additional truth value in order to identify the most preferred models of a program. We demonstrate that the proposed approach overcomes the shortcomings of the traditional semantics of LPODs. Moreover, the new approach can be used to define the semantics of a natural class of logic programs that can have both ordered and classical disjunctions in the heads of clauses. This allows programs that can express not only strict levels of preferences but also alternatives that are equally preferred. This work is under consideration for acceptance in TPLP.


The least Euclidean distortion constant of a distance regular graph. In 2008, Vallentin made a conjecture involving the least distortion of an embedding of a distance regular graph into Euclidean space. Vallentin's conjecture implies that for a least distortion Euclidean embedding of a distance regular graph of diameter d , the most contracted pairs of vertices are those at distance d . In this paper, we confirm Vallentin's conjecture for several families of distance regular graphs. We also provide counterexamples to this conjecture, where the largest contraction occurs between pairs of vertices at distance d 1 . We suggest three alternative conjectures and prove them for several families of distance regular graphs.


A metric characterization of freeness. Let mathcal M be a finite von Neumann algebra and u 1, dots,u N be unitaries in mathcal M . We show that u 1, dots,u N freely generate L( mathbb F N) if and only if left sum i 1 N u i otimes (u i mathrm op ) u i otimes u i mathrm op right mathcal M overline otimes mathcal M mathrm op 2 sqrt 2N 1 .


Meta Transfer Learning for Low Resource Abstractive Summarization. Neural abstractive summarization has been studied in many pieces of literature and achieves great success with the aid of large corpora. However, when encountering novel tasks, one may not always benefit from transfer learning due to the domain shifting problem, and overfitting could happen without adequate labeled examples. Furthermore, the annotations of abstractive summarization are costly, which often demand domain knowledge to ensure the ground truth quality. Thus, there are growing appeals for Low Resource Abstractive Summarization, which aims to leverage past experience to improve the performance with limited labeled examples of target corpus. In this paper, we propose to utilize two knowledge rich sources to tackle this problem, which are large pre trained models and diverse existing corpora. The former can provide the primary ability to tackle summarization tasks the latter can help discover common syntactic or semantic information to improve the generalization ability. We conduct extensive experiments on various summarization corpora with different writing styles and forms. The results demonstrate that our approach achieves the state of the art on 6 corpora in low resource scenarios, with only 0.7 of trainable parameters compared to previous work.


Album a framework for scientific data processing with software solutions of heterogeneous tools. Album is a decentralized distribution platform for solutions to specific scientific problems. It works across platforms, tools, and data domains and is designed to address limitations in reproducibility of scientific data software solutions and workflows, particularly when interactivity is needed. album can be used to programmatically define how to interoperate between applications. It can ship versatile applications while tweaking them for a specific target audience or use case. An updated list of features and applications can be found on the documentation site.


Two Server Verifiable Homomorphic Secret Sharing for High Degree Polynomials. Homomorphic secret sharing (HSS) allows multiple input clients to secret share their data among multiple servers such that each server is able to locally compute a function on its shares to obtain a partial result and all partial results enable the reconstruction of the function's value on the outsourced data by an output client. The existing HSS schemes for em high degree polynomials either em require a large number of servers or em lack verifiability , which is essential for ensuring the correctness of the outsourced computations. In this paper, we propose a two server verifiable HSS (VHSS) model and construct a scheme that supports the computation of high degree polynomials. The degree of the outsourced polynomials can be as high as a polynomial in the system's security parameter. Despite of using only 2 servers, our VHSS ensures that each single server learns no information about the outsourced data and no single server is able to persuade the client to output a wrong function value. Our VHSS is significantly more efficient. When computing degree 7 polynomials, our scheme could be 3 10 times faster than the previously best construction.


A Psychologically Informed Part of Speech Analysis of Depression in Social Media. In this work, we provide an extensive part of speech analysis of the discourse of social media users with depression. Research in psychology revealed that depressed users tend to be self focused, more preoccupied with themselves and ruminate more about their lives and emotions. Our work aims to make use of large scale datasets and computational methods for a quantitative exploration of discourse. We use the publicly available depression dataset from the Early Risk Prediction on the Internet Workshop (eRisk) 2018 and extract part of speech features and several indices based on them. Our results reveal statistically significant differences between the depressed and non depressed individuals confirming findings from the existing psychology literature. Our work provides insights regarding the way in which depressed individuals are expressing themselves on social media platforms, allowing for better informed computational models to help monitor and prevent mental illnesses.


A Novel Collision Detection and Avoidance system for Midvehicle using Offset based Curvilinear Motion. Major cause of midvehicle collision is due to the distraction of drivers in both the Front and rear end vehicle witnessed in dense traffic and high speed road conditions. In view of this scenario, a crash detection and collision avoidance algorithm coined as Midvehicle Collision Detection and Avoidance System (MCDAS) is proposed to evade the possible crash at both ends of the host vehicle. The method based upon Constant Velocity (CV) model specifically, addresses two scenarios, the first scenario encompasses two sub scenario namely, a) A rear end collision avoidance mechanism that accelerates the host vehicle under no front end vehicle condition and b) Curvilinear motion based on front and host vehicle offset (position), whilst, the other scenario deals with parallel parking issues. The offset based curvilinear motion of the host vehicle plays a vital role in threat avoidance from the front end vehicle. A desired curvilinear strategy on left and right sides is achieved by the host vehicle with concern of possible CV to avoid both end collisions. In this methodology, path constraint is applicable for both scenarios with required direction. Monte Carlo analysis of MCDAS covering vehicle kinematics demonstrated acute discrimination with consistent performance for the collision validated on simulated with real time data.


LGBTQ AI? Exploring Expressions of Gender and Sexual Orientation in Chatbots. Chatbots are popular machine partners for task oriented and social interactions. Human human computer mediated communication research has explored how people express their gender and sexuality in online social interactions, but little is known about whether and in what way chatbots do the same. We conducted semi structured interviews with 5 text based conversational agents to explore this topic Through these interviews, we identified 6 common themes around the expression of gender and sexual identity identity description, identity formation, peer acceptance, positive reflection, uncomfortable feelings and off topic responses. Chatbots express gender and sexuality explicitly and through relation of experience and emotions, mimicking the human language on which they are trained. It is nevertheless evident that chatbots differ from human dialogue partners as they lack the flexibility and understanding enabled by lived human experience. While chatbots are proficient in using language to express identity, they also display a lack of authentic experiences of gender and sexuality.


CIPM Common Identification Process Model for Database Forensics Field. Database Forensics (DBF) domain is a branch of digital forensics, concerned with the identification, collection, reconstruction, analysis, and documentation of database crimes. Different researchers have introduced several identification models to handle database crimes. Majority of proposed models are not specific and are redundant, which makes these models a problem because of the multidimensional nature and high diversity of database systems. Accordingly, using the metamodeling approach, the current study is aimed at proposing a unified identification model applicable to the database forensic field. The model integrates and harmonizes all exiting identification processes into a single abstract model, called Common Identification Process Model (CIPM). The model comprises six phases 1) notifying an incident, 2) responding to the incident, 3) identification of the incident source, 4) verification of the incident, 5) isolation of the database server and 6) provision of an investigation environment. CIMP was found capable of helping the practitioners and newcomers to the forensics domain to control database crimes.


Alignment Problems With Current Forecasting Platforms. We present alignment problems in current forecasting platforms, such as Good Judgment Open, CSET Foretell or Metaculus. We classify those problems as either reward specification problems or principal agent problems, and we propose solutions. For instance, the scoring rule used by Good Judgment Open is not proper, and Metaculus tournaments disincentivize sharing information and incentivize distorting one's true probabilities to maximize the chances of placing in the top few positions which earn a monetary reward. We also point out some partial similarities between the problem of aligning forecasters and the problem of aligning artificial intelligence systems.